-- Logs begin at Fri 2022-08-19 15:01:51 UTC, end at Fri 2022-08-19 16:25:05 UTC. -- Aug 19 15:51:46.132144 dv-osbrick-849021-5-ceph systemd[1]: Starting Devstack devstack@keystone.service... Aug 19 15:51:46.143312 dv-osbrick-849021-5-ceph devstack@keystone.service[88355]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 19 15:51:46.145382 dv-osbrick-849021-5-ceph devstack@keystone.service[88355]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 19 15:51:46 2022] *** Aug 19 15:51:46.145382 dv-osbrick-849021-5-ceph devstack@keystone.service[88355]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 19 15:51:46.145382 dv-osbrick-849021-5-ceph devstack@keystone.service[88355]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 19 15:51:46.145382 dv-osbrick-849021-5-ceph devstack@keystone.service[88355]: nodename: dv-osbrick-849021-5-ceph Aug 19 15:51:46.145382 dv-osbrick-849021-5-ceph devstack@keystone.service[88355]: machine: x86_64 Aug 19 15:51:46.145382 dv-osbrick-849021-5-ceph devstack@keystone.service[88355]: clock source: unix Aug 19 15:51:46.145382 dv-osbrick-849021-5-ceph devstack@keystone.service[88355]: pcre jit disabled Aug 19 15:51:46.145382 dv-osbrick-849021-5-ceph devstack@keystone.service[88355]: detected number of CPU cores: 4 Aug 19 15:51:46.145382 dv-osbrick-849021-5-ceph devstack@keystone.service[88355]: current working directory: / Aug 19 15:51:46.145382 dv-osbrick-849021-5-ceph devstack@keystone.service[88355]: detected binary path: /usr/bin/uwsgi-core Aug 19 15:51:46.145382 dv-osbrick-849021-5-ceph devstack@keystone.service[88355]: your processes number limit is 47680 Aug 19 15:51:46.145974 dv-osbrick-849021-5-ceph devstack@keystone.service[88355]: your memory page size is 4096 bytes Aug 19 15:51:46.145974 dv-osbrick-849021-5-ceph devstack@keystone.service[88355]: detected max file descriptor number: 2048 Aug 19 15:51:46.145974 dv-osbrick-849021-5-ceph devstack@keystone.service[88355]: lock engine: pthread robust mutexes Aug 19 15:51:46.145974 dv-osbrick-849021-5-ceph devstack@keystone.service[88355]: thunder lock: enabled Aug 19 15:51:46.145974 dv-osbrick-849021-5-ceph devstack@keystone.service[88355]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 19 15:51:46.145974 dv-osbrick-849021-5-ceph devstack@keystone.service[88355]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 19 15:51:46.190802 dv-osbrick-849021-5-ceph devstack@keystone.service[88355]: Python main interpreter initialized at 0x560058e779c0 Aug 19 15:51:46.190802 dv-osbrick-849021-5-ceph devstack@keystone.service[88355]: python threads support enabled Aug 19 15:51:46.190802 dv-osbrick-849021-5-ceph devstack@keystone.service[88355]: your server socket listen backlog is limited to 100 connections Aug 19 15:51:46.190802 dv-osbrick-849021-5-ceph devstack@keystone.service[88355]: your mercy for graceful operations on workers is 90 seconds Aug 19 15:51:46.191197 dv-osbrick-849021-5-ceph devstack@keystone.service[88355]: mapped 403077 bytes (393 KB) for 2 cores Aug 19 15:51:46.191272 dv-osbrick-849021-5-ceph devstack@keystone.service[88355]: *** Operational MODE: preforking *** Aug 19 15:51:46.191500 dv-osbrick-849021-5-ceph devstack@keystone.service[88355]: *** uWSGI is running in multiple interpreter mode *** Aug 19 15:51:46.191500 dv-osbrick-849021-5-ceph devstack@keystone.service[88355]: spawned uWSGI master process (pid: 88355) Aug 19 15:51:46.191719 dv-osbrick-849021-5-ceph systemd[1]: Started Devstack devstack@keystone.service. Aug 19 15:51:46.192381 dv-osbrick-849021-5-ceph devstack@keystone.service[88355]: spawned uWSGI worker 1 (pid: 88367, cores: 1) Aug 19 15:51:46.192702 dv-osbrick-849021-5-ceph devstack@keystone.service[88355]: spawned uWSGI worker 2 (pid: 88368, cores: 1) Aug 19 15:51:46.192856 dv-osbrick-849021-5-ceph devstack@keystone.service[88355]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 19 15:51:50.983299 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 15:51:50.983299 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: from cryptography.utils import int_from_bytes Aug 19 15:51:50.984130 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 15:51:50.984130 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: from cryptography.utils import int_from_bytes Aug 19 15:51:50.984524 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 15:51:50.984524 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: from cryptography.utils import int_from_bytes Aug 19 15:51:50.984642 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 15:51:50.984642 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: from cryptography.utils import int_from_bytes Aug 19 15:51:51.034963 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 19 15:51:51.035158 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 19 15:51:51.035289 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 19 15:51:51.035432 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] command line args: [] {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 19 15:51:51.035524 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 19 15:51:51.035601 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 19 15:51:51.035677 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] command line args: [] {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 19 15:51:51.035753 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] ================================================================================ {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 19 15:51:51.035917 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 19 15:51:51.036008 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] admin_token = **** {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.036085 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] ================================================================================ {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 19 15:51:51.036205 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] config_dir = [] {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.036336 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] admin_token = **** {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.036414 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.036557 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] config_source = [] {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.036703 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] config_dir = [] {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.036796 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] debug = True {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.036875 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.036954 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.037193 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] config_source = [] {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.037193 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] debug = True {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.037315 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.037374 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.037535 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.037636 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.037728 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.037788 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.037947 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.038034 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.038194 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.038278 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] list_limit = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.038426 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] list_limit = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.038509 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] log_config_append = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.038610 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.038689 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] log_config_append = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.038792 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] log_dir = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.038869 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.038939 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] log_file = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.039003 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] log_dir = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.039113 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] log_file = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.039189 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.039344 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.039428 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.039603 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.039711 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.039831 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.039908 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.040079 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.040235 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.040235 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.041052 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.041052 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.041398 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.041586 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.041786 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.041921 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.042033 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.042148 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.042265 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.042382 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.042505 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.042625 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.042742 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.042859 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.042971 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.043089 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.043211 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.043323 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.043434 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.043545 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.043664 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.70/identity {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.043832 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.70/identity {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.043983 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] publish_errors = False {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.044100 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] publish_errors = False {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.044222 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.044379 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.044475 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.044617 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.044738 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.044834 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.044943 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.045059 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.045163 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.045264 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.045366 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] standard_threads = False {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.045467 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] standard_threads = False {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.045568 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.045661 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.045760 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.045760 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.045953 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.046061 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] use_journal = False {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.046156 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.046286 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] use_json = False {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.046392 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] use_journal = False {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.046485 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] use_stderr = False {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.046674 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] use_json = False {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.046791 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] use_syslog = False {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.046907 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] use_stderr = False {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.046907 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] use_syslog = False {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.047115 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.047225 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:51:51.047344 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.047462 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.047574 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.047684 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.047794 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.047904 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.048022 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.048134 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.048250 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.048367 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.048485 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.048597 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.048736 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.048851 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.048963 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.049073 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.049189 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.049306 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.049429 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.049548 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.049660 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.049770 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.049886 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.049998 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.050117 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.050235 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.050346 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.050463 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.050559 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.050672 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.050791 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.050905 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.051018 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.051134 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.051246 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.051365 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.051478 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.051595 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.051707 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.051707 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.051917 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.051917 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.052206 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.052324 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.052436 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.052546 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.052657 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.052657 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.052898 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.053015 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.053128 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.053294 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.053408 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.053528 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.053646 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.053759 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.053869 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.053869 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.054076 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.054196 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.054308 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.054308 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.054515 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.054663 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.054777 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.054777 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.055001 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.055119 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.055232 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.055232 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.055444 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.055564 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.055675 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.055785 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.055895 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.056063 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.056879 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.057075 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.057267 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.057267 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.057529 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.057529 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.057748 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.057870 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.057983 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.058095 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.058206 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.058320 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.058432 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.058552 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.058665 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.058797 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.058912 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.059028 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.059140 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.059251 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.059373 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.059486 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.059604 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.059717 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.059829 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.059941 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.060060 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.060173 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.060275 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.060371 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.060466 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.060560 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.060743 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.060860 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.060972 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.061084 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.061196 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.061307 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.061436 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.061552 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.061670 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.061783 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.061894 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.062006 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.062130 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.062250 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.062362 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.062474 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.062595 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.062709 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.062833 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.062946 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.063070 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.063184 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.063295 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.063407 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.063527 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.063647 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.063765 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.063879 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.063990 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.064102 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.064286 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.064401 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.064513 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.064625 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.064774 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.064890 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.065014 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.065129 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.065240 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.065351 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.065463 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.065574 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.065701 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.065823 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.065944 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.066057 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.066169 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.066281 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.066428 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.066532 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.066629 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.066868 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.066985 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.067083 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.067176 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.067279 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.067376 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.067476 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.067571 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.067671 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.067768 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.067870 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.067966 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.068060 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.068153 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.068247 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.068340 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.068442 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.068547 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.068641 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.068764 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.068862 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.068862 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.073195 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.073316 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.073397 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.073464 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.073532 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.073613 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.073696 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.073768 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.073836 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.073911 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.073980 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.074050 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.074139 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.074213 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.074282 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.074351 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.074419 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.074488 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.074564 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.074635 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.074704 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.074704 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.074879 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.074950 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.075028 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.075028 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] auth.external = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.075154 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.075222 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.075290 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.075290 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] auth.external = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.075416 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.075488 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.075583 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.075583 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] auth.password = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.075720 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.075791 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] auth.token = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.075866 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.075936 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.076017 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] auth.password = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.076092 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.076162 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] auth.token = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.076232 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.076307 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.076426 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.076510 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.076510 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.076633 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.076726 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.076797 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.076867 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.076949 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.077022 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.077092 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] credential.caching = True {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.077161 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.077230 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.077305 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] credential.caching = True {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.077383 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.077455 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.077525 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.077594 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.077712 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.077787 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.077866 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.077938 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.078008 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.078085 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.078156 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.078227 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.078304 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.078376 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.078453 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.078453 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.078592 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.078592 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.078799 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.078873 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.078943 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.079012 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.079082 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.079082 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.079215 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.079287 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.079357 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.079426 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] federation.caching = True {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.079494 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.079563 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.079641 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.079719 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.079790 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] federation.caching = True {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.079859 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.079935 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.080014 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.080085 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.080208 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.080285 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.080355 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.080424 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.080502 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.080574 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.080644 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.080753 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.080824 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.080894 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.080976 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.081049 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.081119 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.081188 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.081263 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] identity.caching = True {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.081333 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.081411 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.081482 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.081552 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.081622 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] identity.caching = True {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.081691 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.081760 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.081895 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.081977 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.082144 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.082224 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.082378 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.082457 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.082616 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.082695 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.082868 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.082945 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.083112 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.083189 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.083367 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.083447 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.083596 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.083672 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.083828 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.083913 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.084065 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.084143 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.084356 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.084448 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.084556 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.084633 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.084830 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.084948 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.085075 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.085152 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.085329 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.085405 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.085575 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.085653 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.085813 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.085897 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.086046 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.086129 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.086283 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.086361 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.086515 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.086592 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.086751 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.086828 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.086982 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.087058 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.087219 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.087324 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.087492 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.087642 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.087783 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.087910 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.088015 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.088133 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.088212 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.088386 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.088465 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.088624 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.088769 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.088899 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.088976 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.089196 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.089277 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.089526 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.089612 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.089684 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.089760 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.089882 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.089962 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.090115 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.090191 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.090358 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.090435 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.090598 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.090676 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.090837 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.090914 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.091075 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.091161 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.091316 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.091395 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.091580 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.091665 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.091802 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.091887 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.092034 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.092118 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.092270 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.092368 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.092520 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.092603 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.092786 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.092867 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.093025 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.093101 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.093259 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.093334 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.093491 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] ldap.user = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.093570 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.093721 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] ldap.user = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.093796 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.093964 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.094041 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.094227 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.094315 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.094441 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.094520 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.094685 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.094762 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.094959 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.095046 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.095181 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.095259 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.095407 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.095483 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.095639 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.095720 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.095872 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.095956 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.096107 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.096184 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.096337 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.096414 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.096551 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.096632 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.096836 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.096915 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.097078 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.097158 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.097323 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.097400 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.097567 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.097646 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.097796 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.097874 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.098029 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.098105 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.098260 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.098337 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.098494 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.098572 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.098728 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.098806 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.098961 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.099038 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.099197 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.099275 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.099440 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.099516 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.099676 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.099753 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.099917 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.099996 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.100149 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.100226 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.100395 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.100472 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.100722 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.100805 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.100943 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.101020 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.101181 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.101257 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.101421 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.101500 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.101660 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.101736 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.101891 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.101968 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.102127 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.102212 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.102364 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.102440 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] resource.caching = True {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.102607 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] resource.caching = True {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.102683 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.103355 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.103447 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.103692 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.103840 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.103969 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.104096 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.104174 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.104246 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.104396 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.104481 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.104642 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.104799 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.104918 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.105072 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.105189 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.105302 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.105416 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] role.caching = True {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.105539 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.105654 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] role.driver = sql {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.105766 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] role.caching = True {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.105878 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.105991 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] role.driver = sql {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.106103 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.106223 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.106338 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.106451 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.106566 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.106679 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.106791 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.106912 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.107025 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.107138 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.107250 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.107362 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.107474 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.107596 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.107717 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.107831 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.107943 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.108055 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.108167 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.108287 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.108401 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.108514 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.108627 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.108795 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.108912 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.109034 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.109149 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.109261 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.109497 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.109613 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.109749 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.109876 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.109991 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.110104 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.110217 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.110329 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.110451 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.110566 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.110678 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.110793 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.110912 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.111027 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.111148 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.111262 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.111375 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.111488 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.111600 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.111713 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.111834 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.111949 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.112068 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.112166 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.112321 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.112426 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.112576 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.112710 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.112856 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.112961 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.113094 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.113198 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.114667 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.114772 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.114886 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.114999 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.115148 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] token.caching = True {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.115271 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.115393 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.115508 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] token.caching = True {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.115620 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.115732 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.115845 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.115957 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.116079 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.116194 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.116194 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.116406 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.116518 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.116630 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.116811 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.116927 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.117041 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.117155 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.117267 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.117379 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.117379 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.117601 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.117714 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.117826 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.117938 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.118050 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.118171 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.118286 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.118399 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.118531 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.119163 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.119337 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.119536 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.119729 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.119729 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.120016 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.120016 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] database.connection = **** {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.120242 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.120365 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.120488 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] database.connection = **** {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.120611 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.120757 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.120757 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.120974 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.121086 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.121206 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.121327 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.121519 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.121637 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.121750 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.121863 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.121977 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.122089 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.122210 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.122327 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.122441 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.122594 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.122708 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.122822 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.122943 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.123058 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.123171 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.123283 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.123397 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.123513 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.123636 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.123751 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.123864 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.123977 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.124089 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.124202 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.124323 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.124446 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.124562 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.124562 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 19 15:51:51.124835 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:51:51.124835 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 19 15:51:51.158104 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:51:51.158299 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:51:51.158385 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:51:51.158461 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:51:51.158535 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:51:51.158631 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:51:51.167849 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:51:51.169893 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:51:51.199377 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:51:51.199542 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:51:51.199702 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:51:51.199787 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:51:51.274681 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:51:51.275391 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:51:51.324689 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:51:51.324899 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:51:51.325345 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:51:51.325578 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:51:51.397117 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:51:51.397345 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:51:51.397583 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:51:51.397715 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:51:51.397798 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:51:51.397876 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:51:51.397952 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:51:51.398040 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:51:51.398151 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:51:51.398241 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:51:51.398364 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:51:51.398576 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:51:51.422632 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:51:51.422859 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:51:51.422947 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:51:51.423084 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:51:51.423173 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:51:51.423343 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:51:51.423436 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:51:51.423511 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:51:51.423585 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:51:51.423716 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:51:51.423807 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:51:51.423929 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:51:51.424020 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:51:51.424143 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:51:51.435136 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:51:51.435640 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:51:51.467822 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:51:51.468086 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:51:51.468289 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:51:51.468378 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:51:51.468505 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:51:51.468610 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:51:51.468764 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:51:51.468986 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:51:51.469067 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:51:51.469258 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:51:51.469372 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:51:51.469461 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:51:51.469539 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:51:51.469612 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:51:51.487105 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.487292 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.487438 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 19 15:51:51.487527 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 19 15:51:51.487636 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.487832 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.487918 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 19 15:51:51.488033 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 19 15:51:51.488116 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.488309 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.488390 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.488574 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.488654 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.488870 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.488953 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.489135 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.498697 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.498858 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.498981 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.499137 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.499257 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.499406 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.499542 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.499690 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.506853 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88367) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:51:51.507032 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88368) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:51:51.510311 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88367) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:51:51.510599 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.510743 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88368) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:51:51.510893 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.511029 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.511192 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.511313 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.511569 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.511672 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.511774 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.511953 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.512069 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.512152 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.512346 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.512442 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.512620 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.512720 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.512922 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.513003 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.513204 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.513287 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.513468 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.536727 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.537001 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.538147 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88367) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:51:51.538436 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.538518 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88368) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:51:51.538717 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.543216 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88367) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:51:51.543504 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.543613 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88368) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:51:51.543888 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.545487 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.545940 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.551942 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88367) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:51:51.552230 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.552346 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88368) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:51:51.552577 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.556253 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88367) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:51:51.556556 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.556869 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.557076 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88368) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:51:51.557275 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.557363 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.557558 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.557641 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.557845 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.558016 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.558170 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.558319 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.558449 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.558600 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.558906 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.559175 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.574735 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.575019 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.585227 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.585227 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.585424 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88367) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:51:51.585553 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88368) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:51:51.585652 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.585652 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.585801 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.585801 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.586601 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88367) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:51:51.588044 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88368) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:51:51.590306 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88367) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:51:51.591424 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88368) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:51:51.593507 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.593821 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.594112 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.594519 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.594616 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.594805 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.594896 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.595094 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.595184 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.595523 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.595822 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.596108 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.612447 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88367) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:51:51.614078 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.614172 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88368) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:51:51.614277 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.614392 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.614473 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.614563 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.614563 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.620545 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.621474 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.622250 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.622543 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.623138 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.623417 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.625227 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88367) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:51:51.625521 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.625806 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.626100 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.626183 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88368) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:51:51.626383 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.626477 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.626931 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.627213 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.627507 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.639214 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88368) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:51:51.639498 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.639778 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.640079 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.640359 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.640686 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.640944 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.641521 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88367) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:51:51.641810 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.642092 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.642395 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.642690 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.642980 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.643270 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.656975 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88368) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:51:51.659051 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88367) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:51:51.660009 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88368) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:51:51.662149 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88367) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:51:51.663072 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.664506 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.665218 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.666941 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88368) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:51:51.667206 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.667290 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.667517 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.671157 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88367) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:51:51.671157 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.671157 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.674039 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.675486 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88368) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:51:51.675744 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.677234 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88367) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:51:51.678384 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.678674 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.678971 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.679244 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.680351 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.680654 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.681010 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.681778 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.688053 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88368) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:51:51.688343 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.688624 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.689838 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88367) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:51:51.690129 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.690412 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.695410 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88368) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:51:51.696926 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.697138 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88367) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:51:51.697433 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.697697 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.697983 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.698260 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.698507 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.698578 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.698799 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.698888 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.699085 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.699167 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.699365 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.699436 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.699673 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.699766 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.699912 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.699994 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.700179 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.700259 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.700463 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.700551 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.700780 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.701077 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.701345 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.701623 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.701887 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:51:51.734859 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560058e779c0 pid: 88368 (default app) Aug 19 15:51:51.760986 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560058e779c0 pid: 88367 (default app) Aug 19 15:51:51.761118 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de31b0-cfe1-440e-94c1-730e0c7f906f None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:51:51.761118 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de31b0-cfe1-440e-94c1-730e0c7f906f None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:51:51.761118 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de31b0-cfe1-440e-94c1-730e0c7f906f None None] PATH_INFO: `/v3` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:51:51.761118 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 1/1] 10.222.0.70 () {50 vars in 791 bytes} [Fri Aug 19 15:51:51 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:00.439406 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f13614-b374-4e4b-8deb-9b454734d5cb None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:00.439950 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f13614-b374-4e4b-8deb-9b454734d5cb None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:00.439950 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f13614-b374-4e4b-8deb-9b454734d5cb None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:00.444279 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 1/2] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:52:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 15:52:00.450842 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e00469-ba6f-4d4d-924b-a2ed0cc49f44 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:00.451328 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e00469-ba6f-4d4d-924b-a2ed0cc49f44 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:00.451432 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e00469-ba6f-4d4d-924b-a2ed0cc49f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:00.530096 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: INFO dbcounter [None req-85e00469-ba6f-4d4d-924b-a2ed0cc49f44 None None] Registered counter for database keystone Aug 19 15:52:00.551656 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG oslo_db.sqlalchemy.engines [None req-85e00469-ba6f-4d4d-924b-a2ed0cc49f44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88368) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 15:52:00.559334 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writer thread running {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 15:52:00.744601 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG passlib.handlers.bcrypt [None req-85e00469-ba6f-4d4d-924b-a2ed0cc49f44 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88368) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 19 15:52:00.745050 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG passlib.handlers.bcrypt [None req-85e00469-ba6f-4d4d-924b-a2ed0cc49f44 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88368) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 19 15:52:00.800789 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-85e00469-ba6f-4d4d-924b-a2ed0cc49f44 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:52:00.802416 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-85e00469-ba6f-4d4d-924b-a2ed0cc49f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:52:00.938796 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 2/3] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:52:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 489 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 19 15:52:01.501864 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f13614-b374-4e4b-8deb-9b454734d5cb None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:01.580357 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: INFO dbcounter [None req-23f13614-b374-4e4b-8deb-9b454734d5cb None None] Registered counter for database keystone Aug 19 15:52:01.600384 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG oslo_db.sqlalchemy.engines [None req-23f13614-b374-4e4b-8deb-9b454734d5cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88367) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 15:52:01.607029 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writer thread running {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 15:52:01.726302 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f13614-b374-4e4b-8deb-9b454734d5cb None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:01.731490 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0120fe0-d105-47fc-a3e6-0ca027a7edcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e72646e5274546c7b7216d7348ce3bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:01.732119 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0120fe0-d105-47fc-a3e6-0ca027a7edcb admin admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:01.732392 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0120fe0-d105-47fc-a3e6-0ca027a7edcb admin admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:01.732677 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0120fe0-d105-47fc-a3e6-0ca027a7edcb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:01.741594 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0120fe0-d105-47fc-a3e6-0ca027a7edcb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:01.795195 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c0120fe0-d105-47fc-a3e6-0ca027a7edcb admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 19 15:52:01.795533 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0120fe0-d105-47fc-a3e6-0ca027a7edcb admin admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:01.806108 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 2/4] 10.222.0.70 () {58 vars in 1324 bytes} [Fri Aug 19 15:52:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 19 15:52:01.812141 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e00469-ba6f-4d4d-924b-a2ed0cc49f44 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:01.826792 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e00469-ba6f-4d4d-924b-a2ed0cc49f44 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:01.831274 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187aa015-d20a-4095-9d99-68c3c8c24b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e72646e5274546c7b7216d7348ce3bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:01.832385 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187aa015-d20a-4095-9d99-68c3c8c24b90 admin admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:01.832687 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187aa015-d20a-4095-9d99-68c3c8c24b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:01.832967 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187aa015-d20a-4095-9d99-68c3c8c24b90 admin admin] PATH_INFO: `/v3/projects/e72646e5274546c7b7216d7348ce3bc4` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:01.837627 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187aa015-d20a-4095-9d99-68c3c8c24b90 admin admin] RBAC: Authorizing `identity:get_project(project_id=e72646e5274546c7b7216d7348ce3bc4)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:01.887827 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: WARNING keystone.common.rbac_enforcer.enforcer [None req-187aa015-d20a-4095-9d99-68c3c8c24b90 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 19 15:52:01.888084 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187aa015-d20a-4095-9d99-68c3c8c24b90 admin admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:01.892753 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 3/5] 10.222.0.70 () {56 vars in 1207 bytes} [Fri Aug 19 15:52:01 2022] GET /identity/v3/projects/e72646e5274546c7b7216d7348ce3bc4 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:04.073922 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff41eca-17ef-4a04-9918-5e2e9d92fc03 None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:04.074479 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff41eca-17ef-4a04-9918-5e2e9d92fc03 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:04.074479 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff41eca-17ef-4a04-9918-5e2e9d92fc03 None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:04.078528 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 3/6] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:52:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:52:04.083930 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa488ae-d130-4001-9670-524e9b895de3 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:04.084320 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa488ae-d130-4001-9670-524e9b895de3 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:04.084474 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa488ae-d130-4001-9670-524e9b895de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:04.105465 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-afa488ae-d130-4001-9670-524e9b895de3 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:52:04.106977 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-afa488ae-d130-4001-9670-524e9b895de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:52:04.114864 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 4/7] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:52:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 19 15:52:04.448263 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff41eca-17ef-4a04-9918-5e2e9d92fc03 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:04.460693 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff41eca-17ef-4a04-9918-5e2e9d92fc03 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:04.465788 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa78069-9f5f-4bf7-a856-0cbe3d376939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e72646e5274546c7b7216d7348ce3bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:04.466383 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa78069-9f5f-4bf7-a856-0cbe3d376939 admin admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:04.466663 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa78069-9f5f-4bf7-a856-0cbe3d376939 admin admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:04.466936 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa78069-9f5f-4bf7-a856-0cbe3d376939 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:04.474814 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa78069-9f5f-4bf7-a856-0cbe3d376939 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:04.476600 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa78069-9f5f-4bf7-a856-0cbe3d376939 admin admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:04.485941 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 4/8] 10.222.0.70 () {58 vars in 1324 bytes} [Fri Aug 19 15:52:04 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 19 15:52:04.492466 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa488ae-d130-4001-9670-524e9b895de3 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:04.505158 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa488ae-d130-4001-9670-524e9b895de3 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:04.510441 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a88682-cd42-4bba-8264-f4907f8e95fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e72646e5274546c7b7216d7348ce3bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:04.511072 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a88682-cd42-4bba-8264-f4907f8e95fb admin admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:04.511351 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a88682-cd42-4bba-8264-f4907f8e95fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:04.511629 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a88682-cd42-4bba-8264-f4907f8e95fb admin admin] PATH_INFO: `/v3/users/39fb10cdfa334097bc6eed362d01249d` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:04.512977 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a88682-cd42-4bba-8264-f4907f8e95fb admin admin] RBAC: Authorizing `identity:get_user(user_id=39fb10cdfa334097bc6eed362d01249d)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:04.514839 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a88682-cd42-4bba-8264-f4907f8e95fb admin admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:04.516392 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 5/9] 10.222.0.70 () {56 vars in 1198 bytes} [Fri Aug 19 15:52:04 2022] GET /identity/v3/users/39fb10cdfa334097bc6eed362d01249d => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:06.848805 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1476c-13b0-4b12-9f1a-3548b3e94af7 None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:06.849345 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1476c-13b0-4b12-9f1a-3548b3e94af7 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:06.849345 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1476c-13b0-4b12-9f1a-3548b3e94af7 None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:06.850665 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 5/10] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 15:52:06.857819 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10808b9-3ae3-427f-8bd8-7b47ec14f830 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:06.857819 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10808b9-3ae3-427f-8bd8-7b47ec14f830 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:06.857819 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10808b9-3ae3-427f-8bd8-7b47ec14f830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:06.874560 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe6263-9fb5-4f12-bd30-f2f086bd5efc None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:06.875045 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe6263-9fb5-4f12-bd30-f2f086bd5efc None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:06.875527 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe6263-9fb5-4f12-bd30-f2f086bd5efc None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:06.877996 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-e10808b9-3ae3-427f-8bd8-7b47ec14f830 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:52:06.980347 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 6/11] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:52:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 15:52:06.980640 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-e10808b9-3ae3-427f-8bd8-7b47ec14f830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:52:06.980812 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832a885-39e0-4ba3-913c-a45c726a549a None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:06.980812 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832a885-39e0-4ba3-913c-a45c726a549a None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:06.980812 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832a885-39e0-4ba3-913c-a45c726a549a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:06.980812 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG passlib.handlers.bcrypt [None req-2832a885-39e0-4ba3-913c-a45c726a549a None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88367) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 19 15:52:06.980812 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG passlib.handlers.bcrypt [None req-2832a885-39e0-4ba3-913c-a45c726a549a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88367) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 19 15:52:06.980812 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-2832a885-39e0-4ba3-913c-a45c726a549a None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:52:06.982076 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-2832a885-39e0-4ba3-913c-a45c726a549a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:52:06.983191 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 6/12] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:52:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:52:07.100953 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 7/13] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:52:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 15:52:07.372042 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10808b9-3ae3-427f-8bd8-7b47ec14f830 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:07.418071 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:07.473021 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832a885-39e0-4ba3-913c-a45c726a549a None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:07.585345 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832a885-39e0-4ba3-913c-a45c726a549a None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:07.588376 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:07.625086 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ce049-d65c-49b0-94f4-49e89de53f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:07.625982 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ce049-d65c-49b0-94f4-49e89de53f63 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:07.626436 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10808b9-3ae3-427f-8bd8-7b47ec14f830 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:07.626551 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ce049-d65c-49b0-94f4-49e89de53f63 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:07.626776 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ce049-d65c-49b0-94f4-49e89de53f63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:07.670656 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c1cb1-0b42-4465-8653-3e44f13792f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:07.671290 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c1cb1-0b42-4465-8653-3e44f13792f1 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:07.671564 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c1cb1-0b42-4465-8653-3e44f13792f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:07.671834 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c1cb1-0b42-4465-8653-3e44f13792f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:07.684325 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c1cb1-0b42-4465-8653-3e44f13792f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:52:07.693368 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-203c1cb1-0b42-4465-8653-3e44f13792f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:52:07.693368 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:52:07.693368 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:52:07.693368 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:52:07.693368 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:52:07.693368 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:52:07.693368 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:52:07.693368 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:52:07.693368 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:52:07.693368 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:52:07.693368 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:52:07.693368 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:52:07.693368 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:52:07.693368 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:52:07.693368 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:52:07.693368 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:52:07.694602 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:52:07.694602 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:52:07.694602 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:52:07.694602 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:52:07.694602 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:52:07.694602 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:52:07.694602 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:52:07.694602 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:52:07.694602 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:52:07.694602 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:52:07.694602 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:52:07.694602 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:52:07.694602 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:52:07.694602 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:52:07.694602 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:52:07.694602 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:52:07.695555 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:52:07.695555 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:52:07.695555 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:52:07.695555 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:52:07.695555 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:52:07.695555 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:52:07.695555 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:52:07.695555 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:52:07.695555 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:52:07.695555 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:52:07.695555 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:52:07.695555 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:52:07.695555 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 7/14] 10.222.0.70 () {56 vars in 1096 bytes} [Fri Aug 19 15:52:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:52:07.701236 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c1cb1-0b42-4465-8653-3e44f13792f1 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:07.705478 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ce049-d65c-49b0-94f4-49e89de53f63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:07.707118 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ce049-d65c-49b0-94f4-49e89de53f63 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:07.795444 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:07.810831 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 8/15] 10.222.0.70 () {58 vars in 1282 bytes} [Fri Aug 19 15:52:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 15:52:07.817167 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c1cb1-0b42-4465-8653-3e44f13792f1 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:07.817324 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ce049-d65c-49b0-94f4-49e89de53f63 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:07.819429 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:07.850380 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ffcc63-77d4-4234-99bf-11667d592651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:07.850988 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffcc63-77d4-4234-99bf-11667d592651 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:07.851265 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffcc63-77d4-4234-99bf-11667d592651 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:07.851570 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffcc63-77d4-4234-99bf-11667d592651 None admin] PATH_INFO: `/v3/roles` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:07.852985 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ffcc63-77d4-4234-99bf-11667d592651 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:52:07.853292 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ffcc63-77d4-4234-99bf-11667d592651 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:07.854699 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ffcc63-77d4-4234-99bf-11667d592651 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:07.866966 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 8/16] 10.222.0.70 () {56 vars in 1099 bytes} [Fri Aug 19 15:52:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:07.872810 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ffcc63-77d4-4234-99bf-11667d592651 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:07.918797 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ce049-d65c-49b0-94f4-49e89de53f63 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:07.953058 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd2a26-d9b8-42ea-a438-9070e4c38838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:07.953913 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd2a26-d9b8-42ea-a438-9070e4c38838 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:07.954191 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd2a26-d9b8-42ea-a438-9070e4c38838 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:07.954465 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd2a26-d9b8-42ea-a438-9070e4c38838 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:07.973381 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dd2a26-d9b8-42ea-a438-9070e4c38838 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:07.973691 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ffcc63-77d4-4234-99bf-11667d592651 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:07.974844 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dd2a26-d9b8-42ea-a438-9070e4c38838 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:07.994547 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-23dd2a26-d9b8-42ea-a438-9070e4c38838 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:52:07.994547 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:52:07.994547 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:52:07.994547 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:52:07.994547 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:52:07.994547 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:52:07.994547 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:52:07.994547 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:52:07.994547 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:52:07.994547 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:52:07.994547 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:52:07.994547 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:52:07.994547 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:52:07.994547 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:52:07.994547 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:52:07.994547 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:52:07.995494 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:52:07.995494 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:52:07.995494 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:52:07.995494 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:52:07.995494 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:52:07.995494 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:52:07.995494 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:52:07.995494 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:52:07.995494 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:52:07.995494 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:52:07.995494 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:52:07.995494 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:52:07.995494 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:52:07.995494 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:52:07.995494 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:52:07.995494 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:52:07.995494 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:52:07.996295 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:52:07.996295 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:52:07.996295 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:52:07.996295 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 9/17] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:52:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:52:08.001847 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd2a26-d9b8-42ea-a438-9070e4c38838 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:08.007845 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7391549-0b41-4576-a89e-3ebf2934b7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:08.008583 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7391549-0b41-4576-a89e-3ebf2934b7de None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:08.008908 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7391549-0b41-4576-a89e-3ebf2934b7de None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:08.009177 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7391549-0b41-4576-a89e-3ebf2934b7de None admin] PATH_INFO: `/v3/users/39fb10cdfa334097bc6eed362d01249d` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:08.010343 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7391549-0b41-4576-a89e-3ebf2934b7de None admin] RBAC: Authorizing `identity:get_user(user_id=39fb10cdfa334097bc6eed362d01249d)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:08.011786 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7391549-0b41-4576-a89e-3ebf2934b7de None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:08.013423 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 9/18] 10.222.0.70 () {56 vars in 1177 bytes} [Fri Aug 19 15:52:07 2022] GET /identity/v3/users/39fb10cdfa334097bc6eed362d01249d => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:52:08.019058 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7391549-0b41-4576-a89e-3ebf2934b7de None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:08.034573 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:08.061156 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:08.126417 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7391549-0b41-4576-a89e-3ebf2934b7de None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:08.164245 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc4ab5-c1b5-4a6f-a629-d503f637ba2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:08.165552 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc4ab5-c1b5-4a6f-a629-d503f637ba2e None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:08.165824 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc4ab5-c1b5-4a6f-a629-d503f637ba2e None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:08.166082 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc4ab5-c1b5-4a6f-a629-d503f637ba2e None admin] PATH_INFO: `/v3/domains/default` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:08.167398 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc4ab5-c1b5-4a6f-a629-d503f637ba2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:08.168978 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc4ab5-c1b5-4a6f-a629-d503f637ba2e None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:08.170551 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 10/19] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:52:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:52:08.176548 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc4ab5-c1b5-4a6f-a629-d503f637ba2e None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:08.217088 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd2a26-d9b8-42ea-a438-9070e4c38838 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:08.252538 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dddea6-1eac-4902-ace0-b360127801ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:08.253174 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dddea6-1eac-4902-ace0-b360127801ea None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:08.253458 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dddea6-1eac-4902-ace0-b360127801ea None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:08.253732 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dddea6-1eac-4902-ace0-b360127801ea None admin] PATH_INFO: `/v3/domains` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:08.254375 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dddea6-1eac-4902-ace0-b360127801ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:52:08.254673 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dddea6-1eac-4902-ace0-b360127801ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:08.256065 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dddea6-1eac-4902-ace0-b360127801ea None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:08.259764 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:08.273808 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 10/20] 10.222.0.70 () {56 vars in 1109 bytes} [Fri Aug 19 15:52:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:52:08.279273 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc4ab5-c1b5-4a6f-a629-d503f637ba2e None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:08.318115 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ca53d-229e-4b1a-aae2-38127766e14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:08.318710 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ca53d-229e-4b1a-aae2-38127766e14a None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:08.318988 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ca53d-229e-4b1a-aae2-38127766e14a None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:08.319262 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ca53d-229e-4b1a-aae2-38127766e14a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:08.319994 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6ca53d-229e-4b1a-aae2-38127766e14a None admin] RBAC: Adding query filter params (role.id=2f6cb7d6ec874879972a12a63d61068d, scope.domain.id=default, user.id=39fb10cdfa334097bc6eed362d01249d) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:52:08.320303 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6ca53d-229e-4b1a-aae2-38127766e14a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:08.321880 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6ca53d-229e-4b1a-aae2-38127766e14a None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:08.329496 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 11/21] 10.222.0.70 () {56 vars in 1322 bytes} [Fri Aug 19 15:52:08 2022] GET /identity/v3/role_assignments?user.id=39fb10cdfa334097bc6eed362d01249d&scope.domain.id=default&role.id=2f6cb7d6ec874879972a12a63d61068d => generated 233 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:52:10.898343 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd41072-fb7d-4af0-9d9a-bad7556cd151 None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:10.898846 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd41072-fb7d-4af0-9d9a-bad7556cd151 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:10.898944 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd41072-fb7d-4af0-9d9a-bad7556cd151 None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:10.900688 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 11/22] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:52:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:52:10.906037 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db629234-ff25-4867-890c-b36d1cb1807c None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:10.906498 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db629234-ff25-4867-890c-b36d1cb1807c None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:10.906680 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db629234-ff25-4867-890c-b36d1cb1807c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:10.933773 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-db629234-ff25-4867-890c-b36d1cb1807c None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:52:10.935000 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-db629234-ff25-4867-890c-b36d1cb1807c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:52:11.030230 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 12/23] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:52:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:52:11.291489 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83c1d8-87bf-44ec-b4b2-edb637a87ca9 None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:11.291822 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83c1d8-87bf-44ec-b4b2-edb637a87ca9 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:11.292040 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83c1d8-87bf-44ec-b4b2-edb637a87ca9 None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:11.293688 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 12/24] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:52:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:52:11.305150 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed6fa3-8358-48c3-9568-070cc7749392 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:11.306411 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed6fa3-8358-48c3-9568-070cc7749392 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:11.306897 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed6fa3-8358-48c3-9568-070cc7749392 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:11.308472 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 13/25] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:52:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:52:11.312642 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1c92d-ad2b-4f05-87e1-af9f6a1e82f2 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:11.312946 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1c92d-ad2b-4f05-87e1-af9f6a1e82f2 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:11.313219 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1c92d-ad2b-4f05-87e1-af9f6a1e82f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:11.317940 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6435fc-e481-458e-93e3-1c067af8cb3a None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:11.318220 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6435fc-e481-458e-93e3-1c067af8cb3a None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:11.318491 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6435fc-e481-458e-93e3-1c067af8cb3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:11.355100 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-03a1c92d-ad2b-4f05-87e1-af9f6a1e82f2 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:52:11.355100 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-03a1c92d-ad2b-4f05-87e1-af9f6a1e82f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:52:11.370709 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-8b6435fc-e481-458e-93e3-1c067af8cb3a None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:52:11.371903 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-8b6435fc-e481-458e-93e3-1c067af8cb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:52:11.462017 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 14/26] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:52:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 15:52:11.484079 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 13/27] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:52:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 15:52:11.615264 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6435fc-e481-458e-93e3-1c067af8cb3a None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:11.620077 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:11.741671 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6435fc-e481-458e-93e3-1c067af8cb3a None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:11.783202 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a356c181-2eb5-4a76-9487-67711ffe86a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:11.783836 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356c181-2eb5-4a76-9487-67711ffe86a5 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:11.784112 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356c181-2eb5-4a76-9487-67711ffe86a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:11.784382 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356c181-2eb5-4a76-9487-67711ffe86a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:11.801950 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a356c181-2eb5-4a76-9487-67711ffe86a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:52:11.807591 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-a356c181-2eb5-4a76-9487-67711ffe86a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:52:11.807591 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:52:11.807591 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:52:11.807591 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:52:11.807591 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:52:11.807591 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:52:11.807591 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:52:11.807591 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:52:11.807591 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:52:11.807591 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:52:11.807591 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:52:11.807591 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:52:11.807591 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:52:11.807591 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:52:11.807591 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:52:11.807591 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:52:11.808428 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:52:11.808428 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:52:11.808428 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:52:11.808428 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:52:11.808428 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:52:11.808428 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:52:11.808428 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:52:11.808428 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:52:11.808428 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:52:11.808428 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:52:11.808428 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:52:11.808428 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:52:11.808428 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:52:11.808428 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:52:11.808428 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:52:11.808428 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:52:11.809295 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:52:11.809295 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:52:11.809295 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:52:11.809295 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:52:11.809295 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:52:11.809295 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:52:11.809295 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:52:11.809295 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:52:11.809295 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:52:11.809295 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:52:11.809295 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:52:11.809295 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:52:11.809295 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 15/28] 10.222.0.70 () {56 vars in 1096 bytes} [Fri Aug 19 15:52:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:52:11.814926 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a1c92d-ad2b-4f05-87e1-af9f6a1e82f2 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:11.869432 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:11.874604 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c9144b-5abe-4d73-8db5-379730c4e366 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:11.874928 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c9144b-5abe-4d73-8db5-379730c4e366 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:11.875142 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c9144b-5abe-4d73-8db5-379730c4e366 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:11.876936 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 16/29] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:52:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 15:52:11.887964 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3bf874-f0cf-4d3c-95a8-b637bb94ff9d None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:11.888258 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3bf874-f0cf-4d3c-95a8-b637bb94ff9d None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:11.888505 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3bf874-f0cf-4d3c-95a8-b637bb94ff9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:11.913460 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-ea3bf874-f0cf-4d3c-95a8-b637bb94ff9d None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:52:11.914718 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-ea3bf874-f0cf-4d3c-95a8-b637bb94ff9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:52:11.992359 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a1c92d-ad2b-4f05-87e1-af9f6a1e82f2 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:12.016593 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:12.026457 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 17/30] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:52:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 19 15:52:12.031157 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3bf874-f0cf-4d3c-95a8-b637bb94ff9d None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:12.087728 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca01b21-74ff-4ffc-ac00-ee93b07f80e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:12.088362 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca01b21-74ff-4ffc-ac00-ee93b07f80e3 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:12.088642 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca01b21-74ff-4ffc-ac00-ee93b07f80e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:12.088947 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca01b21-74ff-4ffc-ac00-ee93b07f80e3 None admin] PATH_INFO: `/v3/roles` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:12.089915 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca01b21-74ff-4ffc-ac00-ee93b07f80e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:52:12.090217 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca01b21-74ff-4ffc-ac00-ee93b07f80e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:12.091618 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca01b21-74ff-4ffc-ac00-ee93b07f80e3 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:12.114376 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 14/31] 10.222.0.70 () {56 vars in 1099 bytes} [Fri Aug 19 15:52:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:12.115247 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca01b21-74ff-4ffc-ac00-ee93b07f80e3 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:12.223972 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca01b21-74ff-4ffc-ac00-ee93b07f80e3 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:12.238646 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3bf874-f0cf-4d3c-95a8-b637bb94ff9d None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:12.241053 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:12.263779 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f49d7-95d4-456c-a68c-027deb6e4079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:12.271592 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f49d7-95d4-456c-a68c-027deb6e4079 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:12.271592 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f49d7-95d4-456c-a68c-027deb6e4079 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:12.271592 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f49d7-95d4-456c-a68c-027deb6e4079 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:12.277052 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f49d7-95d4-456c-a68c-027deb6e4079 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:12.278617 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f49d7-95d4-456c-a68c-027deb6e4079 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:12.296349 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-671f49d7-95d4-456c-a68c-027deb6e4079 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:52:12.296349 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:52:12.296349 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:52:12.296349 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:52:12.296349 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:52:12.296349 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:52:12.296349 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:52:12.296349 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:52:12.296349 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:52:12.296349 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:52:12.296349 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:52:12.296349 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:52:12.296349 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:52:12.296349 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:52:12.296349 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:52:12.296349 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:52:12.297289 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:52:12.297289 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:52:12.297289 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:52:12.297289 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:52:12.297289 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:52:12.297289 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:52:12.297289 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:52:12.297289 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:52:12.297289 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:52:12.297289 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:52:12.297289 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:52:12.297289 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:52:12.297289 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:52:12.297289 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:52:12.297289 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:52:12.297289 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:52:12.297289 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:52:12.298652 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:52:12.298652 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:52:12.298652 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:52:12.298652 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 15/32] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:52:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:52:12.299927 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f49d7-95d4-456c-a68c-027deb6e4079 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:12.340953 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07f205-d7e2-4451-bea1-6d6fc6c247a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:12.341574 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07f205-d7e2-4451-bea1-6d6fc6c247a8 None admin] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:12.341853 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07f205-d7e2-4451-bea1-6d6fc6c247a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:12.342128 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07f205-d7e2-4451-bea1-6d6fc6c247a8 None admin] PATH_INFO: `/v3/roles` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:12.342795 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de07f205-d7e2-4451-bea1-6d6fc6c247a8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:12.344200 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de07f205-d7e2-4451-bea1-6d6fc6c247a8 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:12.424177 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f49d7-95d4-456c-a68c-027deb6e4079 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:12.463392 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c9eb3-eec6-4c77-a23c-325fa132ac42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:12.464039 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c9eb3-eec6-4c77-a23c-325fa132ac42 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:12.464319 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c9eb3-eec6-4c77-a23c-325fa132ac42 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:12.464598 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c9eb3-eec6-4c77-a23c-325fa132ac42 None admin] PATH_INFO: `/v3/users/39fb10cdfa334097bc6eed362d01249d` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:12.466130 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881c9eb3-eec6-4c77-a23c-325fa132ac42 None admin] RBAC: Authorizing `identity:get_user(user_id=39fb10cdfa334097bc6eed362d01249d)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:12.467663 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881c9eb3-eec6-4c77-a23c-325fa132ac42 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:12.469462 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 16/33] 10.222.0.70 () {56 vars in 1177 bytes} [Fri Aug 19 15:52:12 2022] GET /identity/v3/users/39fb10cdfa334097bc6eed362d01249d => generated 247 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:12.470040 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c9eb3-eec6-4c77-a23c-325fa132ac42 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:12.508294 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:12.576439 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c9eb3-eec6-4c77-a23c-325fa132ac42 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:12.620702 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 18/34] 10.222.0.70 () {60 vars in 1131 bytes} [Fri Aug 19 15:52:12 2022] POST /identity/v3/roles => generated 219 bytes in 586 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:52:12.620702 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07f205-d7e2-4451-bea1-6d6fc6c247a8 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:12.622254 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71fcf1b-66fd-43e9-9698-332e9175e49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:12.622899 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fcf1b-66fd-43e9-9698-332e9175e49a None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:12.623182 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fcf1b-66fd-43e9-9698-332e9175e49a None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:12.623459 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fcf1b-66fd-43e9-9698-332e9175e49a None admin] PATH_INFO: `/v3/domains` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:12.624151 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71fcf1b-66fd-43e9-9698-332e9175e49a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:52:12.624459 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71fcf1b-66fd-43e9-9698-332e9175e49a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:12.625956 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71fcf1b-66fd-43e9-9698-332e9175e49a None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:12.644527 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 17/35] 10.222.0.70 () {56 vars in 1109 bytes} [Fri Aug 19 15:52:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:12.645419 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71fcf1b-66fd-43e9-9698-332e9175e49a None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:12.693320 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:12.745686 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:12.749671 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07f205-d7e2-4451-bea1-6d6fc6c247a8 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:12.759835 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71fcf1b-66fd-43e9-9698-332e9175e49a None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:12.789447 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ab026b-aab1-4e04-998f-044bf6b5f86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:12.790653 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab026b-aab1-4e04-998f-044bf6b5f86c None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:12.790935 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab026b-aab1-4e04-998f-044bf6b5f86c None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:12.791374 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab026b-aab1-4e04-998f-044bf6b5f86c None admin] PATH_INFO: `/v3/domains/default` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:12.793774 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ab026b-aab1-4e04-998f-044bf6b5f86c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:12.795396 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ab026b-aab1-4e04-998f-044bf6b5f86c None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:12.797125 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 19/36] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:52:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:12.798732 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40393f12-7fbb-43b6-9e97-baed514c8f24 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:12.799060 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40393f12-7fbb-43b6-9e97-baed514c8f24 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:12.799358 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40393f12-7fbb-43b6-9e97-baed514c8f24 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:12.800835 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 20/37] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:52:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:52:12.801675 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40393f12-7fbb-43b6-9e97-baed514c8f24 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:12.802649 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111fafd4-0b6e-4814-9671-e3e09866d6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:12.803520 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111fafd4-0b6e-4814-9671-e3e09866d6f1 None admin] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:12.804017 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111fafd4-0b6e-4814-9671-e3e09866d6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:12.804714 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111fafd4-0b6e-4814-9671-e3e09866d6f1 None admin] PATH_INFO: `/v3/roles` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:12.815740 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111fafd4-0b6e-4814-9671-e3e09866d6f1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:12.815740 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111fafd4-0b6e-4814-9671-e3e09866d6f1 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:12.922383 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40393f12-7fbb-43b6-9e97-baed514c8f24 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:12.951667 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:12.967296 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e526a-a878-47c7-b0e4-539f867fb176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:12.967916 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e526a-a878-47c7-b0e4-539f867fb176 None admin] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:12.968191 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e526a-a878-47c7-b0e4-539f867fb176 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:12.968464 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e526a-a878-47c7-b0e4-539f867fb176 None admin] PATH_INFO: `/v3/projects` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:12.969207 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73e526a-a878-47c7-b0e4-539f867fb176 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:12.970684 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73e526a-a878-47c7-b0e4-539f867fb176 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:13.041959 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 18/38] 10.222.0.70 () {60 vars in 1131 bytes} [Fri Aug 19 15:52:12 2022] POST /identity/v3/roles => generated 225 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:52:13.043021 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111fafd4-0b6e-4814-9671-e3e09866d6f1 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:13.124710 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 21/39] 10.222.0.70 () {60 vars in 1141 bytes} [Fri Aug 19 15:52:12 2022] POST /identity/v3/projects => generated 301 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:52:13.124710 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45388010-0e3b-466a-b96b-86e436af8205 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:13.124710 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45388010-0e3b-466a-b96b-86e436af8205 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:13.124710 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45388010-0e3b-466a-b96b-86e436af8205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:13.142353 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-45388010-0e3b-466a-b96b-86e436af8205 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:52:13.144323 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-45388010-0e3b-466a-b96b-86e436af8205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:52:13.188212 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111fafd4-0b6e-4814-9671-e3e09866d6f1 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:13.236914 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 22/40] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:52:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:52:13.238376 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27c672-88b2-44b5-8028-8ee52ab54e60 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:13.238783 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27c672-88b2-44b5-8028-8ee52ab54e60 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:13.239145 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27c672-88b2-44b5-8028-8ee52ab54e60 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:13.240143 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa9ed2-5d0e-4746-bc38-4ab70cf8f066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:13.240820 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 23/41] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:52:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:52:13.241567 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa9ed2-5d0e-4746-bc38-4ab70cf8f066 None admin] REQUEST_METHOD: `PUT` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:13.242184 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa9ed2-5d0e-4746-bc38-4ab70cf8f066 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:13.242816 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa9ed2-5d0e-4746-bc38-4ab70cf8f066 None admin] PATH_INFO: `/v3/domains/default/users/39fb10cdfa334097bc6eed362d01249d/roles/2f6cb7d6ec874879972a12a63d61068d` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:13.247313 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfa9ed2-5d0e-4746-bc38-4ab70cf8f066 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=39fb10cdfa334097bc6eed362d01249d, role_id=2f6cb7d6ec874879972a12a63d61068d)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:13.250788 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfa9ed2-5d0e-4746-bc38-4ab70cf8f066 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:13.255420 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc3c382-9cd8-40d2-a52b-2eb038b68e82 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:13.255778 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc3c382-9cd8-40d2-a52b-2eb038b68e82 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:13.256130 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc3c382-9cd8-40d2-a52b-2eb038b68e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:13.280160 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-9dc3c382-9cd8-40d2-a52b-2eb038b68e82 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:52:13.281630 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-9dc3c382-9cd8-40d2-a52b-2eb038b68e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:52:13.367685 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 19/42] 10.222.0.70 () {58 vars in 1361 bytes} [Fri Aug 19 15:52:13 2022] PUT /identity/v3/domains/default/users/39fb10cdfa334097bc6eed362d01249d/roles/2f6cb7d6ec874879972a12a63d61068d => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:52:13.370095 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 24/43] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:52:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 15:52:13.588001 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa9ed2-5d0e-4746-bc38-4ab70cf8f066 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:13.599309 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:13.690283 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa9ed2-5d0e-4746-bc38-4ab70cf8f066 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:13.719132 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc3c382-9cd8-40d2-a52b-2eb038b68e82 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:13.726629 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a91233-6f5a-4acc-b9ae-b50dc74445cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:13.727841 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a91233-6f5a-4acc-b9ae-b50dc74445cf None admin] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:13.731243 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a91233-6f5a-4acc-b9ae-b50dc74445cf None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:13.731243 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a91233-6f5a-4acc-b9ae-b50dc74445cf None admin] PATH_INFO: `/v3/roles` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:13.731243 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a91233-6f5a-4acc-b9ae-b50dc74445cf None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:13.731243 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a91233-6f5a-4acc-b9ae-b50dc74445cf None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:13.755494 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:13.826539 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc3c382-9cd8-40d2-a52b-2eb038b68e82 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:13.840542 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 20/44] 10.222.0.70 () {60 vars in 1131 bytes} [Fri Aug 19 15:52:13 2022] POST /identity/v3/roles => generated 223 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:52:13.873362 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a053547b-a776-45c0-96b9-a1e4097d7bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:13.874020 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053547b-a776-45c0-96b9-a1e4097d7bc0 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:13.874298 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053547b-a776-45c0-96b9-a1e4097d7bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:13.874587 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053547b-a776-45c0-96b9-a1e4097d7bc0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:13.875742 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a053547b-a776-45c0-96b9-a1e4097d7bc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:13.877642 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a053547b-a776-45c0-96b9-a1e4097d7bc0 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:13.879328 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 25/45] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:52:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:13.885343 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a91233-6f5a-4acc-b9ae-b50dc74445cf None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:13.969906 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:14.009704 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a91233-6f5a-4acc-b9ae-b50dc74445cf None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:14.048166 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2bfbac-8038-4e9d-926c-812394dca3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:14.049409 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2bfbac-8038-4e9d-926c-812394dca3d7 None admin] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:14.049695 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2bfbac-8038-4e9d-926c-812394dca3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:14.049972 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2bfbac-8038-4e9d-926c-812394dca3d7 None admin] PATH_INFO: `/v3/projects` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:14.050638 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2bfbac-8038-4e9d-926c-812394dca3d7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:14.052113 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2bfbac-8038-4e9d-926c-812394dca3d7 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:14.174880 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 21/46] 10.222.0.70 () {60 vars in 1141 bytes} [Fri Aug 19 15:52:13 2022] POST /identity/v3/projects => generated 312 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:52:15.616128 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b01bd-3196-425f-b321-ea18271aa3bb None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:15.616629 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b01bd-3196-425f-b321-ea18271aa3bb None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:15.616629 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b01bd-3196-425f-b321-ea18271aa3bb None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:15.618023 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 26/47] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:52:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:52:15.623875 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ae712-8d74-49e2-8167-cd3bc7525cd8 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:15.624340 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ae712-8d74-49e2-8167-cd3bc7525cd8 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:15.624435 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ae712-8d74-49e2-8167-cd3bc7525cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:15.643819 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-d88ae712-8d74-49e2-8167-cd3bc7525cd8 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:52:15.645385 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-d88ae712-8d74-49e2-8167-cd3bc7525cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:52:15.716094 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 22/48] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:52:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:52:16.051352 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b01bd-3196-425f-b321-ea18271aa3bb None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:16.154396 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b01bd-3196-425f-b321-ea18271aa3bb None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:16.155955 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:16.188878 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fcd192-d4e2-4b0a-b14b-923b5a34cd1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:16.189498 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fcd192-d4e2-4b0a-b14b-923b5a34cd1b None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:16.189780 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fcd192-d4e2-4b0a-b14b-923b5a34cd1b None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:16.190102 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fcd192-d4e2-4b0a-b14b-923b5a34cd1b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:16.200931 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fcd192-d4e2-4b0a-b14b-923b5a34cd1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:52:16.205880 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-74fcd192-d4e2-4b0a-b14b-923b5a34cd1b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:52:16.205880 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:52:16.205880 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:52:16.205880 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:52:16.205880 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:52:16.205880 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:52:16.205880 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:52:16.205880 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:52:16.205880 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:52:16.205880 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:52:16.205880 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:52:16.205880 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:52:16.205880 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:52:16.205880 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:52:16.205880 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:52:16.205880 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:52:16.206735 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:52:16.206735 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:52:16.206735 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:52:16.206735 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:52:16.206735 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:52:16.206735 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:52:16.206735 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:52:16.206735 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:52:16.206735 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:52:16.206735 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:52:16.206735 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:52:16.206735 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:52:16.206735 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:52:16.206735 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:52:16.206735 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:52:16.206735 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:52:16.207684 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:52:16.207684 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:52:16.207684 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:52:16.207684 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:52:16.207684 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:52:16.207684 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:52:16.207684 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:52:16.207684 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:52:16.207684 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:52:16.207684 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:52:16.207684 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:52:16.207684 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:52:16.207684 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 27/49] 10.222.0.70 () {56 vars in 1096 bytes} [Fri Aug 19 15:52:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:52:16.214406 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ae712-8d74-49e2-8167-cd3bc7525cd8 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:16.270971 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:16.326581 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ae712-8d74-49e2-8167-cd3bc7525cd8 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:16.363562 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9eb385-0b23-4d5c-909f-409270dcb9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:16.373494 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9eb385-0b23-4d5c-909f-409270dcb9be None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:16.373494 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9eb385-0b23-4d5c-909f-409270dcb9be None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:16.373494 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9eb385-0b23-4d5c-909f-409270dcb9be None admin] PATH_INFO: `/v3/roles` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:16.373494 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9eb385-0b23-4d5c-909f-409270dcb9be None admin] RBAC: Adding query filter params (name=admin) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:52:16.373494 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9eb385-0b23-4d5c-909f-409270dcb9be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:16.373494 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9eb385-0b23-4d5c-909f-409270dcb9be None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:16.377757 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 23/50] 10.222.0.70 () {56 vars in 1099 bytes} [Fri Aug 19 15:52:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:16.383143 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9eb385-0b23-4d5c-909f-409270dcb9be None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:16.384083 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa6915-9d6f-4c11-af35-a5f99f90a8a6 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:16.384369 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa6915-9d6f-4c11-af35-a5f99f90a8a6 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:16.384640 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa6915-9d6f-4c11-af35-a5f99f90a8a6 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:16.385988 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 28/51] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:52:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:52:16.390980 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75411654-8498-4db3-9bac-e37e2dc1479d None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:16.391336 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75411654-8498-4db3-9bac-e37e2dc1479d None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:16.391771 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75411654-8498-4db3-9bac-e37e2dc1479d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:16.410326 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-75411654-8498-4db3-9bac-e37e2dc1479d None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:52:16.411541 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-75411654-8498-4db3-9bac-e37e2dc1479d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:52:16.484953 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 29/52] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:52:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 15:52:16.494271 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9eb385-0b23-4d5c-909f-409270dcb9be None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:16.511498 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:16.538630 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a3e8b-3325-4e86-bc7e-e2b43a089a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:16.539269 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a3e8b-3325-4e86-bc7e-e2b43a089a0b None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:16.539552 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a3e8b-3325-4e86-bc7e-e2b43a089a0b None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:16.540243 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a3e8b-3325-4e86-bc7e-e2b43a089a0b None admin] PATH_INFO: `/v3/users/39fb10cdfa334097bc6eed362d01249d` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:16.541473 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a3e8b-3325-4e86-bc7e-e2b43a089a0b None admin] RBAC: Authorizing `identity:get_user(user_id=39fb10cdfa334097bc6eed362d01249d)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:16.542923 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a3e8b-3325-4e86-bc7e-e2b43a089a0b None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:16.544648 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 24/53] 10.222.0.70 () {56 vars in 1177 bytes} [Fri Aug 19 15:52:16 2022] GET /identity/v3/users/39fb10cdfa334097bc6eed362d01249d => generated 247 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:52:16.550246 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75411654-8498-4db3-9bac-e37e2dc1479d None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:16.658821 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:16.668835 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75411654-8498-4db3-9bac-e37e2dc1479d None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:16.704145 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927486b9-032a-4e83-b98a-4390334e3902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:16.704846 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927486b9-032a-4e83-b98a-4390334e3902 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:16.705215 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927486b9-032a-4e83-b98a-4390334e3902 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:16.705494 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927486b9-032a-4e83-b98a-4390334e3902 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:16.706613 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927486b9-032a-4e83-b98a-4390334e3902 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:16.708081 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927486b9-032a-4e83-b98a-4390334e3902 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:16.709961 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 30/54] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:52:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:16.716976 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a3e8b-3325-4e86-bc7e-e2b43a089a0b None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:16.814814 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927486b9-032a-4e83-b98a-4390334e3902 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:16.829544 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a3e8b-3325-4e86-bc7e-e2b43a089a0b None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:16.865834 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcae210-334e-4f29-a953-727211ae1aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:16.866458 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcae210-334e-4f29-a953-727211ae1aff None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:16.866745 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcae210-334e-4f29-a953-727211ae1aff None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:16.867021 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcae210-334e-4f29-a953-727211ae1aff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:16.867752 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcae210-334e-4f29-a953-727211ae1aff None admin] RBAC: Adding query filter params (role.id=2f6cb7d6ec874879972a12a63d61068d, scope.domain.id=default, user.id=39fb10cdfa334097bc6eed362d01249d) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:52:16.868604 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcae210-334e-4f29-a953-727211ae1aff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:16.870096 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcae210-334e-4f29-a953-727211ae1aff None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:16.878634 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 25/55] 10.222.0.70 () {56 vars in 1322 bytes} [Fri Aug 19 15:52:16 2022] GET /identity/v3/role_assignments?user.id=39fb10cdfa334097bc6eed362d01249d&scope.domain.id=default&role.id=2f6cb7d6ec874879972a12a63d61068d => generated 530 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:16.931271 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927486b9-032a-4e83-b98a-4390334e3902 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:16.969720 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa305a3-d9d2-44ba-ac4f-f2d5de1796ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:16.970370 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa305a3-d9d2-44ba-ac4f-f2d5de1796ab None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:16.970651 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa305a3-d9d2-44ba-ac4f-f2d5de1796ab None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:16.970927 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa305a3-d9d2-44ba-ac4f-f2d5de1796ab None admin] PATH_INFO: `/v3/domains/default` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:16.972117 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa305a3-d9d2-44ba-ac4f-f2d5de1796ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:16.973621 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa305a3-d9d2-44ba-ac4f-f2d5de1796ab None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:16.975295 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 31/56] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:52:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:52:16.981944 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcae210-334e-4f29-a953-727211ae1aff None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:17.036411 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:17.097351 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcae210-334e-4f29-a953-727211ae1aff None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:17.134476 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07731d62-afd5-4d7b-b24d-a65ac4295247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:17.135132 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07731d62-afd5-4d7b-b24d-a65ac4295247 None admin] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:17.135413 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07731d62-afd5-4d7b-b24d-a65ac4295247 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:17.135688 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07731d62-afd5-4d7b-b24d-a65ac4295247 None admin] PATH_INFO: `/v3/projects` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:17.136383 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07731d62-afd5-4d7b-b24d-a65ac4295247 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:17.137907 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07731d62-afd5-4d7b-b24d-a65ac4295247 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:17.246539 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 26/57] 10.222.0.70 () {60 vars in 1140 bytes} [Fri Aug 19 15:52:16 2022] POST /identity/v3/projects => generated 298 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:52:19.491695 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f6b08e-8ec2-4710-803b-d2bb593fde46 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:19.492203 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f6b08e-8ec2-4710-803b-d2bb593fde46 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:19.492289 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f6b08e-8ec2-4710-803b-d2bb593fde46 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:19.494267 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 32/58] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:52:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:52:19.499571 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2baaf-7d84-40d6-ad30-4dfa5a58526f None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:19.500015 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2baaf-7d84-40d6-ad30-4dfa5a58526f None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:19.500128 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2baaf-7d84-40d6-ad30-4dfa5a58526f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:19.518417 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-33d2baaf-7d84-40d6-ad30-4dfa5a58526f None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:52:19.519643 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-33d2baaf-7d84-40d6-ad30-4dfa5a58526f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:52:19.585323 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 27/59] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:52:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 15:52:19.917757 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f6b08e-8ec2-4710-803b-d2bb593fde46 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:19.946094 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:20.020863 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f6b08e-8ec2-4710-803b-d2bb593fde46 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:20.054628 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cfca53-b599-4cd9-ad7c-7fb5a5833577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:20.055784 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfca53-b599-4cd9-ad7c-7fb5a5833577 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:20.056062 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfca53-b599-4cd9-ad7c-7fb5a5833577 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:20.056337 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfca53-b599-4cd9-ad7c-7fb5a5833577 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:20.057569 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cfca53-b599-4cd9-ad7c-7fb5a5833577 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:20.059013 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cfca53-b599-4cd9-ad7c-7fb5a5833577 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:20.060595 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 33/60] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:52:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:20.066304 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2baaf-7d84-40d6-ad30-4dfa5a58526f None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:20.098828 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:20.176500 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2baaf-7d84-40d6-ad30-4dfa5a58526f None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:20.210834 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb50a2-a236-4180-a1ab-295baa8ae6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:20.211447 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb50a2-a236-4180-a1ab-295baa8ae6cc None admin] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:20.211795 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb50a2-a236-4180-a1ab-295baa8ae6cc None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:20.212066 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb50a2-a236-4180-a1ab-295baa8ae6cc None admin] PATH_INFO: `/v3/users` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:20.212802 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb50a2-a236-4180-a1ab-295baa8ae6cc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:20.214251 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb50a2-a236-4180-a1ab-295baa8ae6cc None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:20.328436 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 28/61] 10.222.0.70 () {60 vars in 1132 bytes} [Fri Aug 19 15:52:20 2022] POST /identity/v3/users => generated 275 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:52:23.958041 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c292da-e4db-4f2f-995a-f6aea8771379 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:23.958692 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c292da-e4db-4f2f-995a-f6aea8771379 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:23.958692 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c292da-e4db-4f2f-995a-f6aea8771379 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:23.959956 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 34/62] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:52:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:52:23.974225 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dbeebc-da98-4b88-ba9e-a53c9b404f15 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:23.975632 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dbeebc-da98-4b88-ba9e-a53c9b404f15 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:23.976511 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dbeebc-da98-4b88-ba9e-a53c9b404f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:23.995244 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3fdaae-0039-43ca-9005-60662a897131 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:23.995528 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3fdaae-0039-43ca-9005-60662a897131 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:23.995781 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3fdaae-0039-43ca-9005-60662a897131 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:23.997346 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 35/63] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:52:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:52:24.005686 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-d1dbeebc-da98-4b88-ba9e-a53c9b404f15 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:52:24.006993 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-d1dbeebc-da98-4b88-ba9e-a53c9b404f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:52:24.011332 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50756a0-d6f3-4fd3-98f9-c641fbbf7cd1 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:24.011608 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50756a0-d6f3-4fd3-98f9-c641fbbf7cd1 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:24.012086 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50756a0-d6f3-4fd3-98f9-c641fbbf7cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:24.036699 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-d50756a0-d6f3-4fd3-98f9-c641fbbf7cd1 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:52:24.038435 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-d50756a0-d6f3-4fd3-98f9-c641fbbf7cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:52:24.085465 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 29/64] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:52:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:52:24.092695 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27ea3a-68ea-4459-8c5f-f9297e727ebf None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:24.093313 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27ea3a-68ea-4459-8c5f-f9297e727ebf None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:24.093784 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27ea3a-68ea-4459-8c5f-f9297e727ebf None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:24.095429 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 30/65] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:52:24 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:52:24.102099 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c258ccf-32b0-481e-9ec2-f178b3d6d777 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:24.102644 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c258ccf-32b0-481e-9ec2-f178b3d6d777 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:24.103246 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c258ccf-32b0-481e-9ec2-f178b3d6d777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:24.116974 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 36/66] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:52:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 15:52:24.137921 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-1c258ccf-32b0-481e-9ec2-f178b3d6d777 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:52:24.139315 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-1c258ccf-32b0-481e-9ec2-f178b3d6d777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:52:24.150852 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:24.234118 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 31/67] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:52:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:52:24.498512 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10408a9a-ec67-47ca-8066-d882a05b8b7f None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:24.499010 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10408a9a-ec67-47ca-8066-d882a05b8b7f None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:24.499431 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10408a9a-ec67-47ca-8066-d882a05b8b7f None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:24.500941 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 37/68] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:52:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:52:24.506565 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d063452-c189-4b73-9e12-970cf94cd77e None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:24.507117 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d063452-c189-4b73-9e12-970cf94cd77e None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:24.507608 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d063452-c189-4b73-9e12-970cf94cd77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:24.537676 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-4d063452-c189-4b73-9e12-970cf94cd77e None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:52:24.539227 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-4d063452-c189-4b73-9e12-970cf94cd77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:52:24.578686 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd0b4c-9148-4372-aafa-dba724c37b61 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:24.579316 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd0b4c-9148-4372-aafa-dba724c37b61 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:24.579804 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd0b4c-9148-4372-aafa-dba724c37b61 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:24.581376 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 38/69] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:52:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 15:52:24.588247 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee1e57-7196-4120-b5a6-6c91b78da2a6 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:24.588529 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee1e57-7196-4120-b5a6-6c91b78da2a6 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:24.588840 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee1e57-7196-4120-b5a6-6c91b78da2a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:24.619713 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-ffee1e57-7196-4120-b5a6-6c91b78da2a6 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:52:24.621302 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-ffee1e57-7196-4120-b5a6-6c91b78da2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:52:24.649679 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 32/70] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:52:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:52:24.651099 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d063452-c189-4b73-9e12-970cf94cd77e None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:24.666057 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:24.706336 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 39/71] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:52:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 15:52:24.707462 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee1e57-7196-4120-b5a6-6c91b78da2a6 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:24.736362 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:24.773941 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d063452-c189-4b73-9e12-970cf94cd77e None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:24.814534 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4423201-0f77-4d35-86a2-42e558ab3a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:24.815543 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4423201-0f77-4d35-86a2-42e558ab3a43 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:24.816045 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4423201-0f77-4d35-86a2-42e558ab3a43 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:24.816523 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4423201-0f77-4d35-86a2-42e558ab3a43 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:24.828984 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee1e57-7196-4120-b5a6-6c91b78da2a6 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:24.829623 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4423201-0f77-4d35-86a2-42e558ab3a43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:52:24.836465 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-e4423201-0f77-4d35-86a2-42e558ab3a43 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:52:24.836465 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:52:24.836465 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:52:24.836465 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:52:24.836465 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:52:24.836465 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:52:24.836465 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:52:24.836465 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:52:24.836465 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:52:24.836465 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:52:24.836465 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:52:24.836465 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:52:24.836465 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:52:24.836465 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:52:24.836465 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:52:24.836465 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:52:24.837616 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:52:24.837616 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:52:24.837616 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:52:24.837616 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:52:24.837616 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:52:24.837616 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:52:24.837616 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:52:24.837616 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:52:24.837616 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:52:24.837616 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:52:24.837616 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:52:24.837616 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:52:24.837616 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:52:24.837616 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:52:24.837616 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:52:24.837616 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:52:24.838508 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:52:24.838508 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:52:24.838508 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:52:24.838508 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:52:24.838508 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:52:24.838508 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:52:24.838508 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:52:24.838508 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:52:24.838508 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:52:24.838508 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:52:24.838508 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:52:24.838508 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:52:24.840878 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 33/72] 10.222.0.70 () {56 vars in 1099 bytes} [Fri Aug 19 15:52:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:52:24.841926 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4423201-0f77-4d35-86a2-42e558ab3a43 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:24.873329 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb88663-df2c-4ee8-a9ab-0928da000acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:24.874025 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb88663-df2c-4ee8-a9ab-0928da000acd None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:24.874426 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb88663-df2c-4ee8-a9ab-0928da000acd None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:24.874753 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb88663-df2c-4ee8-a9ab-0928da000acd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:24.887203 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb88663-df2c-4ee8-a9ab-0928da000acd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:52:24.892807 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-deb88663-df2c-4ee8-a9ab-0928da000acd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 15:52:24.892807 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:52:24.892807 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:52:24.892807 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:52:24.892807 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:52:24.892807 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:52:24.892807 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:52:24.892807 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:52:24.892807 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:52:24.892807 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:52:24.892807 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:52:24.892807 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:52:24.892807 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:52:24.892807 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:52:24.892807 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:52:24.892807 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:52:24.893945 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:52:24.893945 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:52:24.893945 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:52:24.893945 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:52:24.893945 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:52:24.893945 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:52:24.893945 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:52:24.893945 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:52:24.893945 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:52:24.893945 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:52:24.893945 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:52:24.893945 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:52:24.893945 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:52:24.893945 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:52:24.893945 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:52:24.893945 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:52:24.894756 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:52:24.894756 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:52:24.894756 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:52:24.894756 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:52:24.894756 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:52:24.894756 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:52:24.894756 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:52:24.894756 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:52:24.894756 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:52:24.894756 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:52:24.894756 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 15:52:24.894756 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:52:24.894756 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 40/73] 10.222.0.70 () {56 vars in 1114 bytes} [Fri Aug 19 15:52:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:52:24.895391 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb88663-df2c-4ee8-a9ab-0928da000acd None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:24.917310 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:24.962185 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4423201-0f77-4d35-86a2-42e558ab3a43 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:25.003037 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:25.011655 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c90e5f-2668-49fd-b89e-558c2826200d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:25.012322 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c90e5f-2668-49fd-b89e-558c2826200d None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:25.012599 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c90e5f-2668-49fd-b89e-558c2826200d None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:25.012897 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c90e5f-2668-49fd-b89e-558c2826200d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:25.018101 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb88663-df2c-4ee8-a9ab-0928da000acd None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:25.028206 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c90e5f-2668-49fd-b89e-558c2826200d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:52:25.033268 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-f9c90e5f-2668-49fd-b89e-558c2826200d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:52:25.033268 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:52:25.033268 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:52:25.033268 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:52:25.033268 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:52:25.033268 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:52:25.033268 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:52:25.033268 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:52:25.033268 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:52:25.033268 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:52:25.033268 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:52:25.033268 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:52:25.033268 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:52:25.033268 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:52:25.033268 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:52:25.033268 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:52:25.034139 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:52:25.034139 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:52:25.034139 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:52:25.034139 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:52:25.034139 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:52:25.034139 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:52:25.034139 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:52:25.034139 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:52:25.034139 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:52:25.034139 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:52:25.034139 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:52:25.034139 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:52:25.034139 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:52:25.034139 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:52:25.034139 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:52:25.034139 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:52:25.037456 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:52:25.037456 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:52:25.037456 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:52:25.037456 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:52:25.037456 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:52:25.037456 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:52:25.037456 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:52:25.037456 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:52:25.037456 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:52:25.037456 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:52:25.037456 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:52:25.037456 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:52:25.037456 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 34/74] 10.222.0.70 () {56 vars in 1096 bytes} [Fri Aug 19 15:52:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:52:25.037456 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c90e5f-2668-49fd-b89e-558c2826200d None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:25.069011 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5c76c-31d0-4859-922d-453bb91fdb2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:25.069625 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5c76c-31d0-4859-922d-453bb91fdb2d None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:25.069911 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5c76c-31d0-4859-922d-453bb91fdb2d None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:25.070279 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5c76c-31d0-4859-922d-453bb91fdb2d None admin] PATH_INFO: `/v3/roles` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:25.070962 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c5c76c-31d0-4859-922d-453bb91fdb2d None admin] RBAC: Adding query filter params (name=member) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:52:25.071270 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c5c76c-31d0-4859-922d-453bb91fdb2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:25.073409 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c5c76c-31d0-4859-922d-453bb91fdb2d None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:25.083424 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 41/75] 10.222.0.70 () {56 vars in 1101 bytes} [Fri Aug 19 15:52:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:25.086907 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5c76c-31d0-4859-922d-453bb91fdb2d None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:25.152576 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c90e5f-2668-49fd-b89e-558c2826200d None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:25.191168 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecccb78-159c-4af5-a35e-2b915a3d9c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:25.192249 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecccb78-159c-4af5-a35e-2b915a3d9c85 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:25.192781 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecccb78-159c-4af5-a35e-2b915a3d9c85 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:25.193327 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecccb78-159c-4af5-a35e-2b915a3d9c85 None admin] PATH_INFO: `/v3/roles` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:25.194526 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecccb78-159c-4af5-a35e-2b915a3d9c85 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:52:25.195087 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecccb78-159c-4af5-a35e-2b915a3d9c85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:25.195260 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:25.198475 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecccb78-159c-4af5-a35e-2b915a3d9c85 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:25.213050 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 35/76] 10.222.0.70 () {56 vars in 1111 bytes} [Fri Aug 19 15:52:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:25.214011 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecccb78-159c-4af5-a35e-2b915a3d9c85 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:25.224784 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5c76c-31d0-4859-922d-453bb91fdb2d None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:25.264942 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb48f2-d421-44fd-9f18-992959c1f928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:25.265571 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb48f2-d421-44fd-9f18-992959c1f928 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:25.265846 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb48f2-d421-44fd-9f18-992959c1f928 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:25.266117 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb48f2-d421-44fd-9f18-992959c1f928 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:25.267237 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfb48f2-d421-44fd-9f18-992959c1f928 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:25.268719 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfb48f2-d421-44fd-9f18-992959c1f928 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:25.270288 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 42/77] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:52:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:25.274217 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb48f2-d421-44fd-9f18-992959c1f928 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:25.282116 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:25.332445 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecccb78-159c-4af5-a35e-2b915a3d9c85 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:25.371149 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d600e49b-f5d2-4ab4-8eaa-1c8f3f2755a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:25.372147 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600e49b-f5d2-4ab4-8eaa-1c8f3f2755a6 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:25.372627 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600e49b-f5d2-4ab4-8eaa-1c8f3f2755a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:25.373199 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600e49b-f5d2-4ab4-8eaa-1c8f3f2755a6 None admin] PATH_INFO: `/v3/roles` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:25.374190 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d600e49b-f5d2-4ab4-8eaa-1c8f3f2755a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:52:25.374501 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d600e49b-f5d2-4ab4-8eaa-1c8f3f2755a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:25.375893 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d600e49b-f5d2-4ab4-8eaa-1c8f3f2755a6 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:25.380443 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb48f2-d421-44fd-9f18-992959c1f928 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:25.393575 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 36/78] 10.222.0.70 () {56 vars in 1099 bytes} [Fri Aug 19 15:52:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:25.394437 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d600e49b-f5d2-4ab4-8eaa-1c8f3f2755a6 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:25.417521 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b1842-56d3-489b-bec1-a64ab87fb9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:25.418152 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b1842-56d3-489b-bec1-a64ab87fb9c2 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:25.418427 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b1842-56d3-489b-bec1-a64ab87fb9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:25.418693 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b1842-56d3-489b-bec1-a64ab87fb9c2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:25.429018 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5b1842-56d3-489b-bec1-a64ab87fb9c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:52:25.435604 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-9f5b1842-56d3-489b-bec1-a64ab87fb9c2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:52:25.435604 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:52:25.435604 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:52:25.435604 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:52:25.435604 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:52:25.435604 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:52:25.435604 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:52:25.435604 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:52:25.435604 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:52:25.435604 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:52:25.435604 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:52:25.435604 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:52:25.435604 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:52:25.435604 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:52:25.435604 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:52:25.435604 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:52:25.436513 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:52:25.436513 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:52:25.436513 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:52:25.436513 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:52:25.436513 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:52:25.436513 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:52:25.436513 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:52:25.436513 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:52:25.436513 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:52:25.436513 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:52:25.436513 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:52:25.436513 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:52:25.436513 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:52:25.436513 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:52:25.436513 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:52:25.436513 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:52:25.437341 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:52:25.437341 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:52:25.437341 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:52:25.437341 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:52:25.437341 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:52:25.437341 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:52:25.437341 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:52:25.437341 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:52:25.437341 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:52:25.437341 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:52:25.437341 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:52:25.437341 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:52:25.437341 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 43/79] 10.222.0.70 () {56 vars in 1099 bytes} [Fri Aug 19 15:52:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:52:25.437977 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b1842-56d3-489b-bec1-a64ab87fb9c2 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:25.447725 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:25.506498 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d600e49b-f5d2-4ab4-8eaa-1c8f3f2755a6 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:25.524174 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:25.546626 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26634a45-25c3-482c-bf0a-e7d15a1a1e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:25.547172 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26634a45-25c3-482c-bf0a-e7d15a1a1e6f None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:25.547454 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26634a45-25c3-482c-bf0a-e7d15a1a1e6f None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:25.547731 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26634a45-25c3-482c-bf0a-e7d15a1a1e6f None admin] PATH_INFO: `/v3/users/07c52c5ae7fc4412b1e1a11890bb9362` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:25.551706 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b1842-56d3-489b-bec1-a64ab87fb9c2 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:25.564202 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26634a45-25c3-482c-bf0a-e7d15a1a1e6f None admin] RBAC: Authorizing `identity:get_user(user_id=07c52c5ae7fc4412b1e1a11890bb9362)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:25.565724 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26634a45-25c3-482c-bf0a-e7d15a1a1e6f None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:25.567424 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 37/80] 10.222.0.70 () {56 vars in 1177 bytes} [Fri Aug 19 15:52:25 2022] GET /identity/v3/users/07c52c5ae7fc4412b1e1a11890bb9362 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:25.569472 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26634a45-25c3-482c-bf0a-e7d15a1a1e6f None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:25.589268 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec9318-cfe5-4137-b11e-a87de79078d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:25.589903 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec9318-cfe5-4137-b11e-a87de79078d9 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:25.590190 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec9318-cfe5-4137-b11e-a87de79078d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:25.590464 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec9318-cfe5-4137-b11e-a87de79078d9 None admin] PATH_INFO: `/v3/users/07c52c5ae7fc4412b1e1a11890bb9362` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:25.591619 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec9318-cfe5-4137-b11e-a87de79078d9 None admin] RBAC: Authorizing `identity:get_user(user_id=07c52c5ae7fc4412b1e1a11890bb9362)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:25.593145 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec9318-cfe5-4137-b11e-a87de79078d9 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:25.594749 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 44/81] 10.222.0.70 () {56 vars in 1177 bytes} [Fri Aug 19 15:52:25 2022] GET /identity/v3/users/07c52c5ae7fc4412b1e1a11890bb9362 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:25.595509 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec9318-cfe5-4137-b11e-a87de79078d9 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:25.670596 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:25.676569 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26634a45-25c3-482c-bf0a-e7d15a1a1e6f None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:25.695233 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec9318-cfe5-4137-b11e-a87de79078d9 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:25.711252 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f0394-3fdf-4fd1-82f3-6956c70b2b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:25.711861 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f0394-3fdf-4fd1-82f3-6956c70b2b3f None admin] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:25.712137 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f0394-3fdf-4fd1-82f3-6956c70b2b3f None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:25.713169 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f0394-3fdf-4fd1-82f3-6956c70b2b3f None admin] PATH_INFO: `/v3/users` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:25.714103 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f0394-3fdf-4fd1-82f3-6956c70b2b3f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:25.715563 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f0394-3fdf-4fd1-82f3-6956c70b2b3f None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:25.730302 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1aad3c-de1f-4fdd-8629-70fd32cac0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:25.730934 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1aad3c-de1f-4fdd-8629-70fd32cac0bb None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:25.731209 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1aad3c-de1f-4fdd-8629-70fd32cac0bb None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:25.731477 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1aad3c-de1f-4fdd-8629-70fd32cac0bb None admin] PATH_INFO: `/v3/users/39fb10cdfa334097bc6eed362d01249d` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:25.732591 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1aad3c-de1f-4fdd-8629-70fd32cac0bb None admin] RBAC: Authorizing `identity:get_user(user_id=39fb10cdfa334097bc6eed362d01249d)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:25.740489 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1aad3c-de1f-4fdd-8629-70fd32cac0bb None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:25.740489 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 45/82] 10.222.0.70 () {56 vars in 1177 bytes} [Fri Aug 19 15:52:25 2022] GET /identity/v3/users/39fb10cdfa334097bc6eed362d01249d => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:25.740489 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1aad3c-de1f-4fdd-8629-70fd32cac0bb None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:25.802174 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 38/83] 10.222.0.70 () {60 vars in 1132 bytes} [Fri Aug 19 15:52:25 2022] POST /identity/v3/users => generated 289 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:52:25.802886 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f0394-3fdf-4fd1-82f3-6956c70b2b3f None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:25.844329 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1aad3c-de1f-4fdd-8629-70fd32cac0bb None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:25.858382 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:25.885477 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b26d3fc-abc6-4642-8e5d-c8d63257e773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:25.886110 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26d3fc-abc6-4642-8e5d-c8d63257e773 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:25.886461 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26d3fc-abc6-4642-8e5d-c8d63257e773 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:25.886740 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26d3fc-abc6-4642-8e5d-c8d63257e773 None admin] PATH_INFO: `/v3/roles` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:25.887962 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b26d3fc-abc6-4642-8e5d-c8d63257e773 None admin] RBAC: Adding query filter params (name=member) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:52:25.887962 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b26d3fc-abc6-4642-8e5d-c8d63257e773 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:25.889172 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b26d3fc-abc6-4642-8e5d-c8d63257e773 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:25.899673 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 46/84] 10.222.0.70 () {56 vars in 1101 bytes} [Fri Aug 19 15:52:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:25.901380 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b26d3fc-abc6-4642-8e5d-c8d63257e773 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:25.905672 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:25.950608 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f0394-3fdf-4fd1-82f3-6956c70b2b3f None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:26.005202 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc35827-1bc3-417a-8983-b9d914075420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:26.005828 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc35827-1bc3-417a-8983-b9d914075420 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:26.005828 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc35827-1bc3-417a-8983-b9d914075420 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:26.005998 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc35827-1bc3-417a-8983-b9d914075420 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:26.035670 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b26d3fc-abc6-4642-8e5d-c8d63257e773 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:26.083227 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a7fd7-457d-41d8-8fe5-61c4db09bf19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:26.083888 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a7fd7-457d-41d8-8fe5-61c4db09bf19 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:26.084164 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a7fd7-457d-41d8-8fe5-61c4db09bf19 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:26.084437 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a7fd7-457d-41d8-8fe5-61c4db09bf19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:26.096694 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc35827-1bc3-417a-8983-b9d914075420 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:26.098310 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc35827-1bc3-417a-8983-b9d914075420 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:26.131980 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:26.184807 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1a7fd7-457d-41d8-8fe5-61c4db09bf19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:26.187127 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1a7fd7-457d-41d8-8fe5-61c4db09bf19 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:26.191599 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:26.215894 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 39/85] 10.222.0.70 () {58 vars in 1282 bytes} [Fri Aug 19 15:52:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:52:26.217090 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc35827-1bc3-417a-8983-b9d914075420 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:26.331924 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 47/86] 10.222.0.70 () {58 vars in 1282 bytes} [Fri Aug 19 15:52:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:52:26.333094 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a7fd7-457d-41d8-8fe5-61c4db09bf19 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:26.344385 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc35827-1bc3-417a-8983-b9d914075420 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:26.384274 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:26.391071 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a7de77-6e73-4f4d-8cb2-4651c537bd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:26.391695 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7de77-6e73-4f4d-8cb2-4651c537bd2a None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:26.391981 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7de77-6e73-4f4d-8cb2-4651c537bd2a None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:26.392261 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7de77-6e73-4f4d-8cb2-4651c537bd2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:26.475344 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a7de77-6e73-4f4d-8cb2-4651c537bd2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:26.477680 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a7de77-6e73-4f4d-8cb2-4651c537bd2a None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:26.494732 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a7fd7-457d-41d8-8fe5-61c4db09bf19 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:26.497721 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:26.536894 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbaf906-761b-4af5-8e6f-98db181ec877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:26.537938 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbaf906-761b-4af5-8e6f-98db181ec877 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:26.538424 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbaf906-761b-4af5-8e6f-98db181ec877 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:26.538889 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbaf906-761b-4af5-8e6f-98db181ec877 None admin] PATH_INFO: `/v3/users/07c52c5ae7fc4412b1e1a11890bb9362` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:26.540578 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbaf906-761b-4af5-8e6f-98db181ec877 None admin] RBAC: Authorizing `identity:get_user(user_id=07c52c5ae7fc4412b1e1a11890bb9362)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:26.543143 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbaf906-761b-4af5-8e6f-98db181ec877 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:26.545971 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 48/87] 10.222.0.70 () {56 vars in 1177 bytes} [Fri Aug 19 15:52:26 2022] GET /identity/v3/users/07c52c5ae7fc4412b1e1a11890bb9362 => generated 275 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:26.547554 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbaf906-761b-4af5-8e6f-98db181ec877 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:26.602832 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 40/88] 10.222.0.70 () {58 vars in 1282 bytes} [Fri Aug 19 15:52:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:52:26.605438 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a7de77-6e73-4f4d-8cb2-4651c537bd2a None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:26.647634 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:26.676514 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbaf906-761b-4af5-8e6f-98db181ec877 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:26.713024 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6de9c-f8c5-4e51-a847-c374a65e85b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:26.713799 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6de9c-f8c5-4e51-a847-c374a65e85b5 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:26.714082 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6de9c-f8c5-4e51-a847-c374a65e85b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:26.714411 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6de9c-f8c5-4e51-a847-c374a65e85b5 None admin] PATH_INFO: `/v3/projects/2e809a1a094b48538c004035badbc88e` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:26.715542 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b6de9c-f8c5-4e51-a847-c374a65e85b5 None admin] RBAC: Authorizing `identity:get_project(project_id=2e809a1a094b48538c004035badbc88e)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:26.717113 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b6de9c-f8c5-4e51-a847-c374a65e85b5 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:26.718932 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 49/89] 10.222.0.70 () {56 vars in 1186 bytes} [Fri Aug 19 15:52:26 2022] GET /identity/v3/projects/2e809a1a094b48538c004035badbc88e => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:26.724427 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6de9c-f8c5-4e51-a847-c374a65e85b5 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:26.743489 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a7de77-6e73-4f4d-8cb2-4651c537bd2a None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:26.770293 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:26.794368 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e87a2-800a-450a-b29b-1b931d73a27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:26.795525 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e87a2-800a-450a-b29b-1b931d73a27a None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:26.795981 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e87a2-800a-450a-b29b-1b931d73a27a None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:26.796424 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e87a2-800a-450a-b29b-1b931d73a27a None admin] PATH_INFO: `/v3/projects/2e809a1a094b48538c004035badbc88e` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:26.797920 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e87a2-800a-450a-b29b-1b931d73a27a None admin] RBAC: Authorizing `identity:get_project(project_id=2e809a1a094b48538c004035badbc88e)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:26.800282 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e87a2-800a-450a-b29b-1b931d73a27a None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:26.803084 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 41/90] 10.222.0.70 () {56 vars in 1186 bytes} [Fri Aug 19 15:52:26 2022] GET /identity/v3/projects/2e809a1a094b48538c004035badbc88e => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:26.804044 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e87a2-800a-450a-b29b-1b931d73a27a None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:26.840440 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6de9c-f8c5-4e51-a847-c374a65e85b5 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:26.878231 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5684e8ee-d4ea-4553-a425-c0ae0e70e4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:26.878850 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684e8ee-d4ea-4553-a425-c0ae0e70e4be None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:26.879206 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684e8ee-d4ea-4553-a425-c0ae0e70e4be None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:26.879551 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684e8ee-d4ea-4553-a425-c0ae0e70e4be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:26.933073 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:26.937106 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e87a2-800a-450a-b29b-1b931d73a27a None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:26.972843 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5684e8ee-d4ea-4553-a425-c0ae0e70e4be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:26.974417 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2194f1-4141-4917-9176-1b78c13098a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:26.974960 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5684e8ee-d4ea-4553-a425-c0ae0e70e4be None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:26.975171 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2194f1-4141-4917-9176-1b78c13098a4 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:26.975590 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2194f1-4141-4917-9176-1b78c13098a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:26.975938 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2194f1-4141-4917-9176-1b78c13098a4 None admin] PATH_INFO: `/v3/projects/2e809a1a094b48538c004035badbc88e` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:26.977230 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2194f1-4141-4917-9176-1b78c13098a4 None admin] RBAC: Authorizing `identity:get_project(project_id=2e809a1a094b48538c004035badbc88e)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:26.979336 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2194f1-4141-4917-9176-1b78c13098a4 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:26.981441 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 42/91] 10.222.0.70 () {56 vars in 1186 bytes} [Fri Aug 19 15:52:26 2022] GET /identity/v3/projects/2e809a1a094b48538c004035badbc88e => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:26.982445 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2194f1-4141-4917-9176-1b78c13098a4 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:27.033099 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:27.097098 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 50/92] 10.222.0.70 () {58 vars in 1282 bytes} [Fri Aug 19 15:52:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:52:27.098030 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5684e8ee-d4ea-4553-a425-c0ae0e70e4be None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:27.134728 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2194f1-4141-4917-9176-1b78c13098a4 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:27.187148 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e2e941-46b9-448b-ae93-3d0a2798ead1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:27.188092 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2e941-46b9-448b-ae93-3d0a2798ead1 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:27.188520 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2e941-46b9-448b-ae93-3d0a2798ead1 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:27.189156 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2e941-46b9-448b-ae93-3d0a2798ead1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:27.190163 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e2e941-46b9-448b-ae93-3d0a2798ead1 None admin] RBAC: Adding query filter params (role.id=09971bc698e84205be000073fc048af2, scope.project.id=2e809a1a094b48538c004035badbc88e, user.id=07c52c5ae7fc4412b1e1a11890bb9362) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:52:27.190772 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e2e941-46b9-448b-ae93-3d0a2798ead1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:27.192781 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e2e941-46b9-448b-ae93-3d0a2798ead1 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:27.208814 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 43/93] 10.222.0.70 () {56 vars in 1374 bytes} [Fri Aug 19 15:52:26 2022] GET /identity/v3/role_assignments?user.id=07c52c5ae7fc4412b1e1a11890bb9362&scope.project.id=2e809a1a094b48538c004035badbc88e&role.id=09971bc698e84205be000073fc048af2 => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:27.211490 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e2e941-46b9-448b-ae93-3d0a2798ead1 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:27.232701 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5684e8ee-d4ea-4553-a425-c0ae0e70e4be None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:27.292695 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b835b-288e-4676-aa1e-3ddf56c167f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:27.292695 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b835b-288e-4676-aa1e-3ddf56c167f9 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:27.292996 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:27.295309 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b835b-288e-4676-aa1e-3ddf56c167f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:27.295627 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b835b-288e-4676-aa1e-3ddf56c167f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:27.297494 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771b835b-288e-4676-aa1e-3ddf56c167f9 None admin] RBAC: Adding query filter params (role.id=294bcd6132ef46d48aff3efa4d77fa0a, scope.project.id=2e809a1a094b48538c004035badbc88e, user.id=07c52c5ae7fc4412b1e1a11890bb9362) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:52:27.297835 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771b835b-288e-4676-aa1e-3ddf56c167f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:27.302062 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771b835b-288e-4676-aa1e-3ddf56c167f9 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:27.317342 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 51/94] 10.222.0.70 () {56 vars in 1374 bytes} [Fri Aug 19 15:52:27 2022] GET /identity/v3/role_assignments?user.id=07c52c5ae7fc4412b1e1a11890bb9362&scope.project.id=2e809a1a094b48538c004035badbc88e&role.id=294bcd6132ef46d48aff3efa4d77fa0a => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:27.318578 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b835b-288e-4676-aa1e-3ddf56c167f9 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:27.328159 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:27.490292 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e2e941-46b9-448b-ae93-3d0a2798ead1 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:27.551508 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011cd27-b33c-4b1e-bdf7-c918b3ea47d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:27.552343 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011cd27-b33c-4b1e-bdf7-c918b3ea47d0 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:27.552749 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011cd27-b33c-4b1e-bdf7-c918b3ea47d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:27.553471 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011cd27-b33c-4b1e-bdf7-c918b3ea47d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:27.554702 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8011cd27-b33c-4b1e-bdf7-c918b3ea47d0 None admin] RBAC: Adding query filter params (role.id=2f6cb7d6ec874879972a12a63d61068d, scope.project.id=2e809a1a094b48538c004035badbc88e, user.id=39fb10cdfa334097bc6eed362d01249d) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:52:27.555134 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8011cd27-b33c-4b1e-bdf7-c918b3ea47d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:27.557576 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8011cd27-b33c-4b1e-bdf7-c918b3ea47d0 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:27.560574 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b835b-288e-4676-aa1e-3ddf56c167f9 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:27.565548 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 44/95] 10.222.0.70 () {56 vars in 1374 bytes} [Fri Aug 19 15:52:27 2022] GET /identity/v3/role_assignments?user.id=39fb10cdfa334097bc6eed362d01249d&scope.project.id=2e809a1a094b48538c004035badbc88e&role.id=2f6cb7d6ec874879972a12a63d61068d => generated 259 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:27.624582 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4988e3f-572a-4191-b88b-5c35a7a3e501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:27.625275 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4988e3f-572a-4191-b88b-5c35a7a3e501 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:27.625558 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4988e3f-572a-4191-b88b-5c35a7a3e501 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:27.625834 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4988e3f-572a-4191-b88b-5c35a7a3e501 None admin] PATH_INFO: `/v3/projects/963d02180caa42f79e40d9b4e2528065` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:27.627297 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4988e3f-572a-4191-b88b-5c35a7a3e501 None admin] RBAC: Authorizing `identity:get_project(project_id=963d02180caa42f79e40d9b4e2528065)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:27.628795 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4988e3f-572a-4191-b88b-5c35a7a3e501 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:27.630468 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 52/96] 10.222.0.70 () {56 vars in 1186 bytes} [Fri Aug 19 15:52:27 2022] GET /identity/v3/projects/963d02180caa42f79e40d9b4e2528065 => generated 312 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:27.637566 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011cd27-b33c-4b1e-bdf7-c918b3ea47d0 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:27.781146 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:27.787743 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011cd27-b33c-4b1e-bdf7-c918b3ea47d0 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:27.828770 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a82ac-e330-4817-9642-d6a3feb017d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:27.829545 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a82ac-e330-4817-9642-d6a3feb017d1 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:27.829987 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a82ac-e330-4817-9642-d6a3feb017d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:27.830333 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a82ac-e330-4817-9642-d6a3feb017d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:27.831137 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25a82ac-e330-4817-9642-d6a3feb017d1 None admin] RBAC: Adding query filter params (role.id=09971bc698e84205be000073fc048af2, scope.project.id=963d02180caa42f79e40d9b4e2528065, user.id=07c52c5ae7fc4412b1e1a11890bb9362) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:52:27.831523 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25a82ac-e330-4817-9642-d6a3feb017d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:27.833016 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25a82ac-e330-4817-9642-d6a3feb017d1 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:27.840393 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 45/97] 10.222.0.70 () {56 vars in 1374 bytes} [Fri Aug 19 15:52:27 2022] GET /identity/v3/role_assignments?user.id=07c52c5ae7fc4412b1e1a11890bb9362&scope.project.id=963d02180caa42f79e40d9b4e2528065&role.id=09971bc698e84205be000073fc048af2 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:28.530867 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85b80a-2a3c-40d4-b725-861b5c12b7af None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:28.531733 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85b80a-2a3c-40d4-b725-861b5c12b7af None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:28.532174 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85b80a-2a3c-40d4-b725-861b5c12b7af None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:28.533796 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 53/98] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:52:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:52:28.539607 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ff1b4-45f4-4151-9cab-f4a96fb9cb5a None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:28.541040 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ff1b4-45f4-4151-9cab-f4a96fb9cb5a None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:28.541661 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ff1b4-45f4-4151-9cab-f4a96fb9cb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:28.569797 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-bf5ff1b4-45f4-4151-9cab-f4a96fb9cb5a None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:52:28.571238 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-bf5ff1b4-45f4-4151-9cab-f4a96fb9cb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:52:28.658800 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 46/99] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:52:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:52:28.802819 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ef78f-2412-4cc7-beac-64dffa395f41 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:28.803467 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ef78f-2412-4cc7-beac-64dffa395f41 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:28.804002 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ef78f-2412-4cc7-beac-64dffa395f41 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:28.805826 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 54/100] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:52:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 15:52:28.812554 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6de56-a4e0-4899-894f-58222cda0987 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:28.813193 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6de56-a4e0-4899-894f-58222cda0987 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:28.813674 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6de56-a4e0-4899-894f-58222cda0987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:28.845251 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-d1a6de56-a4e0-4899-894f-58222cda0987 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:52:28.846805 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-d1a6de56-a4e0-4899-894f-58222cda0987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:52:28.955633 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 47/101] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:52:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:52:29.220416 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738ef78f-2412-4cc7-beac-64dffa395f41 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:29.313495 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:29.361345 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738ef78f-2412-4cc7-beac-64dffa395f41 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:29.401001 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16966368-aeea-440a-b4ac-729340daee0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:29.401639 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16966368-aeea-440a-b4ac-729340daee0f None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:29.401923 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16966368-aeea-440a-b4ac-729340daee0f None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:29.402197 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16966368-aeea-440a-b4ac-729340daee0f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:29.413147 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16966368-aeea-440a-b4ac-729340daee0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:52:29.419039 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-16966368-aeea-440a-b4ac-729340daee0f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 15:52:29.419039 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:52:29.419039 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:52:29.419039 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:52:29.419039 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:52:29.419039 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:52:29.419039 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:52:29.419039 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:52:29.419039 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:52:29.419039 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:52:29.419039 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:52:29.419039 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:52:29.419039 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:52:29.419039 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:52:29.419039 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:52:29.419039 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:52:29.426740 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:52:29.426740 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:52:29.426740 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:52:29.426740 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:52:29.426740 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:52:29.426740 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:52:29.426740 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:52:29.426740 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:52:29.426740 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:52:29.426740 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:52:29.426740 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:52:29.426740 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:52:29.426740 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:52:29.426740 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:52:29.426740 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:52:29.426740 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:52:29.427493 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:52:29.427493 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:52:29.427493 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:52:29.427493 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:52:29.427493 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:52:29.427493 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:52:29.427493 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:52:29.427493 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:52:29.427493 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:52:29.427493 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:52:29.427493 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 15:52:29.427493 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:52:29.427493 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 55/102] 10.222.0.70 () {56 vars in 1099 bytes} [Fri Aug 19 15:52:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:52:29.429900 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a6de56-a4e0-4899-894f-58222cda0987 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:29.461392 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:29.562885 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a6de56-a4e0-4899-894f-58222cda0987 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:29.606847 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16966368-aeea-440a-b4ac-729340daee0f None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:29.621557 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a8a10-4dc6-4d86-aed7-431f64147d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:29.622183 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a8a10-4dc6-4d86-aed7-431f64147d99 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:29.622469 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a8a10-4dc6-4d86-aed7-431f64147d99 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:29.622744 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a8a10-4dc6-4d86-aed7-431f64147d99 None admin] PATH_INFO: `/v3/roles` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:29.623418 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3a8a10-4dc6-4d86-aed7-431f64147d99 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:52:29.623724 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3a8a10-4dc6-4d86-aed7-431f64147d99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:29.625389 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3a8a10-4dc6-4d86-aed7-431f64147d99 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:29.641689 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 48/103] 10.222.0.70 () {56 vars in 1101 bytes} [Fri Aug 19 15:52:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:29.647528 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a8a10-4dc6-4d86-aed7-431f64147d99 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:29.744274 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:29.765232 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a8a10-4dc6-4d86-aed7-431f64147d99 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:29.816498 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16966368-aeea-440a-b4ac-729340daee0f None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:29.830370 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a448b4d9-8f59-4e7c-9327-100cbde3df3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:29.831552 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448b4d9-8f59-4e7c-9327-100cbde3df3a None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:29.832049 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448b4d9-8f59-4e7c-9327-100cbde3df3a None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:29.832532 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448b4d9-8f59-4e7c-9327-100cbde3df3a None admin] PATH_INFO: `/v3/users/079333c22795432e83a2d1a50caec117` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:29.852267 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:29.859711 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac6a00-130e-4987-9919-23f9e8b0dc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:29.859880 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a448b4d9-8f59-4e7c-9327-100cbde3df3a None admin] RBAC: Authorizing `identity:get_user(user_id=079333c22795432e83a2d1a50caec117)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:29.860649 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac6a00-130e-4987-9919-23f9e8b0dc48 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:29.866792 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac6a00-130e-4987-9919-23f9e8b0dc48 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:29.866792 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac6a00-130e-4987-9919-23f9e8b0dc48 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:29.867157 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a448b4d9-8f59-4e7c-9327-100cbde3df3a None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:29.867249 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac6a00-130e-4987-9919-23f9e8b0dc48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:29.867320 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 49/104] 10.222.0.70 () {56 vars in 1177 bytes} [Fri Aug 19 15:52:29 2022] GET /identity/v3/users/079333c22795432e83a2d1a50caec117 => generated 289 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:52:29.867395 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac6a00-130e-4987-9919-23f9e8b0dc48 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:29.870362 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 56/105] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:52:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:29.873082 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a448b4d9-8f59-4e7c-9327-100cbde3df3a None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:29.877772 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac6a00-130e-4987-9919-23f9e8b0dc48 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:30.007969 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac6a00-130e-4987-9919-23f9e8b0dc48 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:30.050642 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04245072-a767-4abe-8dcb-0d1d4649f8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:30.051916 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04245072-a767-4abe-8dcb-0d1d4649f8c1 None admin] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:30.052403 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04245072-a767-4abe-8dcb-0d1d4649f8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:30.052917 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04245072-a767-4abe-8dcb-0d1d4649f8c1 None admin] PATH_INFO: `/v3/projects` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:30.053781 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04245072-a767-4abe-8dcb-0d1d4649f8c1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:30.055805 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04245072-a767-4abe-8dcb-0d1d4649f8c1 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:30.093951 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a448b4d9-8f59-4e7c-9327-100cbde3df3a None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:30.138454 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc30e7-89bc-46f1-b4f4-5f6677bde793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:30.146575 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc30e7-89bc-46f1-b4f4-5f6677bde793 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:30.146575 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc30e7-89bc-46f1-b4f4-5f6677bde793 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:30.146575 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc30e7-89bc-46f1-b4f4-5f6677bde793 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:30.152294 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:30.178287 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 57/106] 10.222.0.70 () {60 vars in 1141 bytes} [Fri Aug 19 15:52:29 2022] POST /identity/v3/projects => generated 302 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:52:30.245167 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fc30e7-89bc-46f1-b4f4-5f6677bde793 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:30.246727 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fc30e7-89bc-46f1-b4f4-5f6677bde793 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:30.370464 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 50/107] 10.222.0.70 () {58 vars in 1282 bytes} [Fri Aug 19 15:52:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:52:30.376153 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04245072-a767-4abe-8dcb-0d1d4649f8c1 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:30.485771 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:30.551640 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04245072-a767-4abe-8dcb-0d1d4649f8c1 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:30.600597 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09875847-eb07-434b-b3e4-a77b513e9f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:30.601670 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09875847-eb07-434b-b3e4-a77b513e9f74 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:30.602200 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09875847-eb07-434b-b3e4-a77b513e9f74 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:30.602678 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09875847-eb07-434b-b3e4-a77b513e9f74 None admin] PATH_INFO: `/v3/projects/2e809a1a094b48538c004035badbc88e` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:30.605157 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09875847-eb07-434b-b3e4-a77b513e9f74 None admin] RBAC: Authorizing `identity:get_project(project_id=2e809a1a094b48538c004035badbc88e)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:30.607127 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09875847-eb07-434b-b3e4-a77b513e9f74 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:30.609894 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 58/108] 10.222.0.70 () {56 vars in 1186 bytes} [Fri Aug 19 15:52:30 2022] GET /identity/v3/projects/2e809a1a094b48538c004035badbc88e => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:30.616018 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc30e7-89bc-46f1-b4f4-5f6677bde793 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:30.664871 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4959eb4-9ab1-46cd-8fed-a19c0b34f710 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:30.666066 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4959eb4-9ab1-46cd-8fed-a19c0b34f710 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:30.666570 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4959eb4-9ab1-46cd-8fed-a19c0b34f710 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:30.668700 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 59/109] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:52:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:52:30.673951 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d91820-2435-4f0d-b32f-84c75ae8c2f0 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:30.674499 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d91820-2435-4f0d-b32f-84c75ae8c2f0 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:30.674973 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:30.676176 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d91820-2435-4f0d-b32f-84c75ae8c2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:30.697429 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-c0d91820-2435-4f0d-b32f-84c75ae8c2f0 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:52:30.703216 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-c0d91820-2435-4f0d-b32f-84c75ae8c2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:52:30.766131 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc30e7-89bc-46f1-b4f4-5f6677bde793 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:30.777473 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 60/110] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:52:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 15:52:30.809161 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e15db1-8c37-4aac-bd0a-e6d717bbfba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:30.810179 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e15db1-8c37-4aac-bd0a-e6d717bbfba6 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:30.810668 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e15db1-8c37-4aac-bd0a-e6d717bbfba6 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:30.811148 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e15db1-8c37-4aac-bd0a-e6d717bbfba6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:30.812093 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e15db1-8c37-4aac-bd0a-e6d717bbfba6 None admin] RBAC: Adding query filter params (role.id=2e3dded4c3734675b1978c6f9ec33c7b, scope.project.id=2e809a1a094b48538c004035badbc88e, user.id=079333c22795432e83a2d1a50caec117) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:52:30.812609 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e15db1-8c37-4aac-bd0a-e6d717bbfba6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:30.814350 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e15db1-8c37-4aac-bd0a-e6d717bbfba6 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:30.820963 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 51/111] 10.222.0.70 () {56 vars in 1374 bytes} [Fri Aug 19 15:52:30 2022] GET /identity/v3/role_assignments?user.id=079333c22795432e83a2d1a50caec117&scope.project.id=2e809a1a094b48538c004035badbc88e&role.id=2e3dded4c3734675b1978c6f9ec33c7b => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:30.890636 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053c9fb-f932-4453-a9f9-2a3efc47c633 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:30.891251 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053c9fb-f932-4453-a9f9-2a3efc47c633 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:30.891725 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053c9fb-f932-4453-a9f9-2a3efc47c633 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:30.893333 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 61/112] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:52:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:52:30.899324 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23191f-5dae-4c40-adc0-866088c80a87 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:30.900000 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23191f-5dae-4c40-adc0-866088c80a87 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:30.901169 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23191f-5dae-4c40-adc0-866088c80a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:30.926441 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-ba23191f-5dae-4c40-adc0-866088c80a87 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:52:30.928026 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-ba23191f-5dae-4c40-adc0-866088c80a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:52:31.018749 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 52/113] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:52:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:52:31.244694 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f053c9fb-f932-4453-a9f9-2a3efc47c633 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:31.323134 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:31.414042 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f053c9fb-f932-4453-a9f9-2a3efc47c633 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:31.437643 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd1b32-e3ef-4430-9aeb-6aefe1ffe63e None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:31.438153 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd1b32-e3ef-4430-9aeb-6aefe1ffe63e None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:31.438649 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd1b32-e3ef-4430-9aeb-6aefe1ffe63e None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:31.442652 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 53/114] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:52:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:52:31.451927 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c68d1-b790-4a27-b1ca-18638479f230 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:31.452413 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c68d1-b790-4a27-b1ca-18638479f230 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:31.452961 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c68d1-b790-4a27-b1ca-18638479f230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:31.491938 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f03bb4f-0769-4939-993e-58596e97a1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:31.493007 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03bb4f-0769-4939-993e-58596e97a1fd None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:31.493489 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03bb4f-0769-4939-993e-58596e97a1fd None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:31.493994 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03bb4f-0769-4939-993e-58596e97a1fd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:31.513664 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-1d4c68d1-b790-4a27-b1ca-18638479f230 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:52:31.516025 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-1d4c68d1-b790-4a27-b1ca-18638479f230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:52:31.529373 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f03bb4f-0769-4939-993e-58596e97a1fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:52:31.534699 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-3f03bb4f-0769-4939-993e-58596e97a1fd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 15:52:31.534699 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:52:31.534699 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:52:31.534699 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:52:31.534699 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:52:31.534699 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:52:31.534699 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:52:31.534699 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:52:31.534699 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:52:31.534699 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:52:31.534699 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:52:31.534699 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:52:31.534699 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:52:31.534699 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:52:31.534699 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:52:31.534699 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:52:31.535615 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:52:31.535615 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:52:31.535615 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:52:31.535615 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:52:31.535615 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:52:31.535615 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:52:31.535615 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:52:31.535615 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:52:31.535615 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:52:31.535615 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:52:31.535615 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:52:31.535615 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:52:31.535615 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:52:31.535615 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:52:31.535615 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:52:31.535615 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:52:31.536367 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:52:31.536367 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:52:31.536367 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:52:31.536367 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:52:31.536367 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:52:31.536367 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:52:31.536367 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:52:31.536367 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:52:31.536367 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:52:31.536367 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:52:31.536367 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 15:52:31.536367 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:52:31.539063 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 62/115] 10.222.0.70 () {56 vars in 1114 bytes} [Fri Aug 19 15:52:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:52:31.540142 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f03bb4f-0769-4939-993e-58596e97a1fd None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:31.567141 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:31.640289 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 54/116] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:52:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:52:31.641492 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c68d1-b790-4a27-b1ca-18638479f230 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:31.763626 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c68d1-b790-4a27-b1ca-18638479f230 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:31.769011 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f03bb4f-0769-4939-993e-58596e97a1fd None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:31.797719 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:31.812154 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e3cca5-6f8f-4dae-ab9e-e82ee74eff39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:31.812810 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3cca5-6f8f-4dae-ab9e-e82ee74eff39 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:31.813109 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3cca5-6f8f-4dae-ab9e-e82ee74eff39 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:31.813363 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3cca5-6f8f-4dae-ab9e-e82ee74eff39 None admin] PATH_INFO: `/v3/roles` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:31.814037 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e3cca5-6f8f-4dae-ab9e-e82ee74eff39 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:52:31.814344 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e3cca5-6f8f-4dae-ab9e-e82ee74eff39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:31.815974 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e3cca5-6f8f-4dae-ab9e-e82ee74eff39 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:31.833036 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 55/117] 10.222.0.70 () {56 vars in 1111 bytes} [Fri Aug 19 15:52:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:31.836025 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65206a4d-a4d2-4bff-9de8-8848747c343e None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:31.836025 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65206a4d-a4d2-4bff-9de8-8848747c343e None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:31.836025 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65206a4d-a4d2-4bff-9de8-8848747c343e None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:31.836025 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 56/118] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:52:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:52:31.839641 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65206a4d-a4d2-4bff-9de8-8848747c343e None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:31.843997 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d96d9-91ca-4c73-beb5-d0cac0372025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:31.845353 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d96d9-91ca-4c73-beb5-d0cac0372025 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:31.846059 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d96d9-91ca-4c73-beb5-d0cac0372025 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:31.846832 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d96d9-91ca-4c73-beb5-d0cac0372025 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:31.867083 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d96d9-91ca-4c73-beb5-d0cac0372025 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:52:31.877973 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-067d96d9-91ca-4c73-beb5-d0cac0372025 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:52:31.877973 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:52:31.877973 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:52:31.877973 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:52:31.877973 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:52:31.877973 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:52:31.877973 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:52:31.877973 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:52:31.877973 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:52:31.877973 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:52:31.877973 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:52:31.877973 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:52:31.877973 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:52:31.877973 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:52:31.877973 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:52:31.877973 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:52:31.879627 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:52:31.879627 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:52:31.879627 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:52:31.879627 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:52:31.879627 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:52:31.879627 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:52:31.879627 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:52:31.879627 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:52:31.879627 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:52:31.879627 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:52:31.879627 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:52:31.879627 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:52:31.879627 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:52:31.879627 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:52:31.879627 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:52:31.879627 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:52:31.881897 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:52:31.881897 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:52:31.881897 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:52:31.881897 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:52:31.881897 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:52:31.881897 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:52:31.881897 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:52:31.881897 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:52:31.881897 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:52:31.881897 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:52:31.881897 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:52:31.881897 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:52:31.887452 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:31.888053 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 63/119] 10.222.0.70 () {56 vars in 1099 bytes} [Fri Aug 19 15:52:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:52:31.890674 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58fe0e3-b8f5-452d-a41f-66bce09c330a None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:31.898434 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58fe0e3-b8f5-452d-a41f-66bce09c330a None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:31.898434 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58fe0e3-b8f5-452d-a41f-66bce09c330a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:31.945960 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-a58fe0e3-b8f5-452d-a41f-66bce09c330a None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:52:31.948753 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-a58fe0e3-b8f5-452d-a41f-66bce09c330a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:52:32.090311 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 64/120] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:52:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:52:32.092292 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58fe0e3-b8f5-452d-a41f-66bce09c330a None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:32.117387 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65206a4d-a4d2-4bff-9de8-8848747c343e None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:32.230235 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af1e80e-fe46-4969-ba6e-581106e234fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:32.230507 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1e80e-fe46-4969-ba6e-581106e234fd None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:32.230679 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1e80e-fe46-4969-ba6e-581106e234fd None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:32.230931 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1e80e-fe46-4969-ba6e-581106e234fd None admin] PATH_INFO: `/v3/users/07c52c5ae7fc4412b1e1a11890bb9362` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:32.232067 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af1e80e-fe46-4969-ba6e-581106e234fd None admin] RBAC: Authorizing `identity:get_user(user_id=07c52c5ae7fc4412b1e1a11890bb9362)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:32.233547 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af1e80e-fe46-4969-ba6e-581106e234fd None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:32.235145 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 57/121] 10.222.0.70 () {56 vars in 1177 bytes} [Fri Aug 19 15:52:31 2022] GET /identity/v3/users/07c52c5ae7fc4412b1e1a11890bb9362 => generated 275 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:32.240705 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af1e80e-fe46-4969-ba6e-581106e234fd None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:32.296901 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:32.305427 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58fe0e3-b8f5-452d-a41f-66bce09c330a None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:32.368993 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:32.385356 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af1e80e-fe46-4969-ba6e-581106e234fd None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:32.391794 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c473ea9-2e75-4ce9-94ce-88891ddfb7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:32.392433 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c473ea9-2e75-4ce9-94ce-88891ddfb7fe None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:32.392732 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c473ea9-2e75-4ce9-94ce-88891ddfb7fe None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:32.393005 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c473ea9-2e75-4ce9-94ce-88891ddfb7fe None admin] PATH_INFO: `/v3/roles` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:32.393690 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c473ea9-2e75-4ce9-94ce-88891ddfb7fe None admin] RBAC: Adding query filter params (name=member) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:52:32.393989 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c473ea9-2e75-4ce9-94ce-88891ddfb7fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:32.395444 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c473ea9-2e75-4ce9-94ce-88891ddfb7fe None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:32.413980 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 65/122] 10.222.0.70 () {56 vars in 1101 bytes} [Fri Aug 19 15:52:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:32.414827 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c473ea9-2e75-4ce9-94ce-88891ddfb7fe None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:32.457636 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13872d8c-c3b4-4381-9699-bf7bf3516f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:32.458281 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13872d8c-c3b4-4381-9699-bf7bf3516f8c None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:32.458558 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13872d8c-c3b4-4381-9699-bf7bf3516f8c None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:32.458828 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13872d8c-c3b4-4381-9699-bf7bf3516f8c None admin] PATH_INFO: `/v3/projects/2e809a1a094b48538c004035badbc88e` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:32.460810 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13872d8c-c3b4-4381-9699-bf7bf3516f8c None admin] RBAC: Authorizing `identity:get_project(project_id=2e809a1a094b48538c004035badbc88e)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:32.462254 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13872d8c-c3b4-4381-9699-bf7bf3516f8c None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:32.467964 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 58/123] 10.222.0.70 () {56 vars in 1186 bytes} [Fri Aug 19 15:52:32 2022] GET /identity/v3/projects/2e809a1a094b48538c004035badbc88e => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:52:32.468816 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13872d8c-c3b4-4381-9699-bf7bf3516f8c None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:32.571880 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c473ea9-2e75-4ce9-94ce-88891ddfb7fe None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:32.613874 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13872d8c-c3b4-4381-9699-bf7bf3516f8c None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:32.621085 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7670fd5-6de0-470d-a04a-414250884f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:32.622640 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7670fd5-6de0-470d-a04a-414250884f26 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:32.623163 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7670fd5-6de0-470d-a04a-414250884f26 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:32.623628 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7670fd5-6de0-470d-a04a-414250884f26 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:32.643318 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7670fd5-6de0-470d-a04a-414250884f26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:52:32.648614 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-d7670fd5-6de0-470d-a04a-414250884f26 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:52:32.648614 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:52:32.648614 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:52:32.648614 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:52:32.648614 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:52:32.648614 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:52:32.648614 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:52:32.648614 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:52:32.648614 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:52:32.648614 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:52:32.648614 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:52:32.648614 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:52:32.648614 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:52:32.648614 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:52:32.648614 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:52:32.648614 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:52:32.649468 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:52:32.649468 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:52:32.649468 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:52:32.649468 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:52:32.649468 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:52:32.649468 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:52:32.649468 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:52:32.649468 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:52:32.649468 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:52:32.649468 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:52:32.649468 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:52:32.649468 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:52:32.649468 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:52:32.649468 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:52:32.649468 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:52:32.649468 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:52:32.651503 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:52:32.651503 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:52:32.651503 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:52:32.651503 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:52:32.651503 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:52:32.651503 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:52:32.651503 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:52:32.651503 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:52:32.651503 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:52:32.651503 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:52:32.651503 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:52:32.651503 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:52:32.651503 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 66/124] 10.222.0.70 () {56 vars in 1096 bytes} [Fri Aug 19 15:52:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:52:32.651503 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7670fd5-6de0-470d-a04a-414250884f26 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:32.661486 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2f69c-9b82-40f3-a692-502123b04ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:32.662758 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2f69c-9b82-40f3-a692-502123b04ec0 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:32.663228 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2f69c-9b82-40f3-a692-502123b04ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:32.663763 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2f69c-9b82-40f3-a692-502123b04ec0 None admin] PATH_INFO: `/v3/users/07c52c5ae7fc4412b1e1a11890bb9362` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:32.666380 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd2f69c-9b82-40f3-a692-502123b04ec0 None admin] RBAC: Authorizing `identity:get_user(user_id=07c52c5ae7fc4412b1e1a11890bb9362)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:32.668642 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd2f69c-9b82-40f3-a692-502123b04ec0 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:32.671478 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 59/125] 10.222.0.70 () {56 vars in 1177 bytes} [Fri Aug 19 15:52:32 2022] GET /identity/v3/users/07c52c5ae7fc4412b1e1a11890bb9362 => generated 275 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:32.672771 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2f69c-9b82-40f3-a692-502123b04ec0 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:32.683369 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:32.714320 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:32.764092 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7670fd5-6de0-470d-a04a-414250884f26 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:32.801339 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b954e-a160-4a88-8db8-3c9c962d56f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:32.802128 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b954e-a160-4a88-8db8-3c9c962d56f4 None admin] REQUEST_METHOD: `PUT` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:32.802315 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b954e-a160-4a88-8db8-3c9c962d56f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:32.802553 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b954e-a160-4a88-8db8-3c9c962d56f4 None admin] PATH_INFO: `/v3/projects/2e809a1a094b48538c004035badbc88e/users/07c52c5ae7fc4412b1e1a11890bb9362/roles/294bcd6132ef46d48aff3efa4d77fa0a` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:32.805110 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721b954e-a160-4a88-8db8-3c9c962d56f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=2e809a1a094b48538c004035badbc88e, user_id=07c52c5ae7fc4412b1e1a11890bb9362, role_id=294bcd6132ef46d48aff3efa4d77fa0a)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:32.807102 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721b954e-a160-4a88-8db8-3c9c962d56f4 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:32.818954 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2f69c-9b82-40f3-a692-502123b04ec0 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:32.856407 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99fb03d-b7d7-4d01-a74a-356a50fa1bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:32.857500 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99fb03d-b7d7-4d01-a74a-356a50fa1bfa None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:32.858006 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99fb03d-b7d7-4d01-a74a-356a50fa1bfa None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:32.858591 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99fb03d-b7d7-4d01-a74a-356a50fa1bfa None admin] PATH_INFO: `/v3/roles/member` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:32.870757 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99fb03d-b7d7-4d01-a74a-356a50fa1bfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:52:32.877440 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-b99fb03d-b7d7-4d01-a74a-356a50fa1bfa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:52:32.877440 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:52:32.877440 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:52:32.877440 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:52:32.877440 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:52:32.877440 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:52:32.877440 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:52:32.877440 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:52:32.877440 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:52:32.877440 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:52:32.877440 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:52:32.877440 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:52:32.877440 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:52:32.877440 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:52:32.877440 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:52:32.877440 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:52:32.879306 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:52:32.879306 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:52:32.879306 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:52:32.879306 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:52:32.879306 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:52:32.879306 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:52:32.879306 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:52:32.879306 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:52:32.879306 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:52:32.879306 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:52:32.879306 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:52:32.879306 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:52:32.879306 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:52:32.879306 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:52:32.879306 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:52:32.879306 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:52:32.880252 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:52:32.880252 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:52:32.880252 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:52:32.880252 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:52:32.880252 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:52:32.880252 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:52:32.880252 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:52:32.880252 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:52:32.880252 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:52:32.880252 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:52:32.880252 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:52:32.880252 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:52:32.881445 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 60/126] 10.222.0.70 () {56 vars in 1099 bytes} [Fri Aug 19 15:52:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:52:32.882389 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99fb03d-b7d7-4d01-a74a-356a50fa1bfa None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:32.912871 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 67/127] 10.222.0.70 () {58 vars in 1439 bytes} [Fri Aug 19 15:52:32 2022] PUT /identity/v3/projects/2e809a1a094b48538c004035badbc88e/users/07c52c5ae7fc4412b1e1a11890bb9362/roles/294bcd6132ef46d48aff3efa4d77fa0a => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:52:32.922731 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b954e-a160-4a88-8db8-3c9c962d56f4 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:33.052657 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:33.079859 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99fb03d-b7d7-4d01-a74a-356a50fa1bfa None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:33.121720 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:33.158311 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9465e3-ff5e-4359-8645-7bbf6662d97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:33.158945 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9465e3-ff5e-4359-8645-7bbf6662d97e None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:33.161375 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b954e-a160-4a88-8db8-3c9c962d56f4 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:33.164322 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9465e3-ff5e-4359-8645-7bbf6662d97e None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:33.164322 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9465e3-ff5e-4359-8645-7bbf6662d97e None admin] PATH_INFO: `/v3/roles` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:33.164322 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9465e3-ff5e-4359-8645-7bbf6662d97e None admin] RBAC: Adding query filter params (name=admin) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:52:33.164322 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9465e3-ff5e-4359-8645-7bbf6662d97e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:33.168006 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9465e3-ff5e-4359-8645-7bbf6662d97e None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:33.187168 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 61/128] 10.222.0.70 () {56 vars in 1099 bytes} [Fri Aug 19 15:52:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:33.188946 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9465e3-ff5e-4359-8645-7bbf6662d97e None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:33.222260 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a793f7b-be66-4201-8beb-4d1024f1ce57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:33.222898 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a793f7b-be66-4201-8beb-4d1024f1ce57 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:33.223169 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a793f7b-be66-4201-8beb-4d1024f1ce57 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:33.223436 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a793f7b-be66-4201-8beb-4d1024f1ce57 None admin] PATH_INFO: `/v3/projects/2e809a1a094b48538c004035badbc88e` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:33.224777 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a793f7b-be66-4201-8beb-4d1024f1ce57 None admin] RBAC: Authorizing `identity:get_project(project_id=2e809a1a094b48538c004035badbc88e)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:33.226080 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a793f7b-be66-4201-8beb-4d1024f1ce57 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:33.228081 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 68/129] 10.222.0.70 () {56 vars in 1186 bytes} [Fri Aug 19 15:52:32 2022] GET /identity/v3/projects/2e809a1a094b48538c004035badbc88e => generated 298 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:33.229274 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a793f7b-be66-4201-8beb-4d1024f1ce57 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:33.310164 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9465e3-ff5e-4359-8645-7bbf6662d97e None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:33.339974 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a793f7b-be66-4201-8beb-4d1024f1ce57 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:33.378378 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d86ad-1709-4562-ac18-c0e883bf0374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:33.378378 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d86ad-1709-4562-ac18-c0e883bf0374 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:33.378378 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d86ad-1709-4562-ac18-c0e883bf0374 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:33.378378 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d86ad-1709-4562-ac18-c0e883bf0374 None admin] PATH_INFO: `/v3/roles` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:33.379310 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d86ad-1709-4562-ac18-c0e883bf0374 None admin] RBAC: Adding query filter params (name=member) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:52:33.379310 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d86ad-1709-4562-ac18-c0e883bf0374 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:33.379310 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d86ad-1709-4562-ac18-c0e883bf0374 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:33.379310 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 62/130] 10.222.0.70 () {56 vars in 1101 bytes} [Fri Aug 19 15:52:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:33.379310 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d86ad-1709-4562-ac18-c0e883bf0374 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:33.383080 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb91ce-b333-472c-808d-74aa6d02bf96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:33.384169 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb91ce-b333-472c-808d-74aa6d02bf96 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:33.384593 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb91ce-b333-472c-808d-74aa6d02bf96 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:33.385031 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb91ce-b333-472c-808d-74aa6d02bf96 None admin] PATH_INFO: `/v3/users/39fb10cdfa334097bc6eed362d01249d` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:33.386631 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eb91ce-b333-472c-808d-74aa6d02bf96 None admin] RBAC: Authorizing `identity:get_user(user_id=39fb10cdfa334097bc6eed362d01249d)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:33.390079 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eb91ce-b333-472c-808d-74aa6d02bf96 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:33.390550 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 69/131] 10.222.0.70 () {56 vars in 1177 bytes} [Fri Aug 19 15:52:33 2022] GET /identity/v3/users/39fb10cdfa334097bc6eed362d01249d => generated 247 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:33.391505 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb91ce-b333-472c-808d-74aa6d02bf96 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:33.393056 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:33.415022 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:33.496697 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d86ad-1709-4562-ac18-c0e883bf0374 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:33.514916 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb91ce-b333-472c-808d-74aa6d02bf96 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:33.534503 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900fbaa4-9598-4168-ba91-582f4b320358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:33.535246 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900fbaa4-9598-4168-ba91-582f4b320358 None admin] REQUEST_METHOD: `PUT` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:33.535629 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900fbaa4-9598-4168-ba91-582f4b320358 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:33.535982 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900fbaa4-9598-4168-ba91-582f4b320358 None admin] PATH_INFO: `/v3/projects/2e809a1a094b48538c004035badbc88e/users/07c52c5ae7fc4412b1e1a11890bb9362/roles/09971bc698e84205be000073fc048af2` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:33.538068 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900fbaa4-9598-4168-ba91-582f4b320358 None admin] RBAC: Authorizing `identity:create_grant(project_id=2e809a1a094b48538c004035badbc88e, user_id=07c52c5ae7fc4412b1e1a11890bb9362, role_id=09971bc698e84205be000073fc048af2)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:33.539605 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900fbaa4-9598-4168-ba91-582f4b320358 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:33.556421 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72996f7c-d382-4775-9960-14a2b23b9cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:33.558619 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72996f7c-d382-4775-9960-14a2b23b9cdf None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:33.558619 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72996f7c-d382-4775-9960-14a2b23b9cdf None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:33.558619 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72996f7c-d382-4775-9960-14a2b23b9cdf None admin] PATH_INFO: `/v3/users/07c52c5ae7fc4412b1e1a11890bb9362` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:33.558934 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72996f7c-d382-4775-9960-14a2b23b9cdf None admin] RBAC: Authorizing `identity:get_user(user_id=07c52c5ae7fc4412b1e1a11890bb9362)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:33.560396 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72996f7c-d382-4775-9960-14a2b23b9cdf None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:33.562072 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 70/132] 10.222.0.70 () {56 vars in 1177 bytes} [Fri Aug 19 15:52:33 2022] GET /identity/v3/users/07c52c5ae7fc4412b1e1a11890bb9362 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:33.563109 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72996f7c-d382-4775-9960-14a2b23b9cdf None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:33.644016 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 63/133] 10.222.0.70 () {58 vars in 1439 bytes} [Fri Aug 19 15:52:33 2022] PUT /identity/v3/projects/2e809a1a094b48538c004035badbc88e/users/07c52c5ae7fc4412b1e1a11890bb9362/roles/09971bc698e84205be000073fc048af2 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:52:33.646003 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43022419-e00f-4628-8066-e80f2976e643 None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:33.646297 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43022419-e00f-4628-8066-e80f2976e643 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:33.646659 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43022419-e00f-4628-8066-e80f2976e643 None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:33.649253 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 64/134] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:52:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:52:33.650436 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43022419-e00f-4628-8066-e80f2976e643 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:33.658604 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:33.676773 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72996f7c-d382-4775-9960-14a2b23b9cdf None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:33.716276 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3d96bc-015f-4ea9-b65a-2203dec33f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:33.716975 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d96bc-015f-4ea9-b65a-2203dec33f47 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:33.717254 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d96bc-015f-4ea9-b65a-2203dec33f47 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:33.717523 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d96bc-015f-4ea9-b65a-2203dec33f47 None admin] PATH_INFO: `/v3/projects/2e809a1a094b48538c004035badbc88e` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:33.719228 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3d96bc-015f-4ea9-b65a-2203dec33f47 None admin] RBAC: Authorizing `identity:get_project(project_id=2e809a1a094b48538c004035badbc88e)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:33.720767 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3d96bc-015f-4ea9-b65a-2203dec33f47 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:33.722566 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 71/135] 10.222.0.70 () {56 vars in 1186 bytes} [Fri Aug 19 15:52:33 2022] GET /identity/v3/projects/2e809a1a094b48538c004035badbc88e => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:33.723852 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b08afb-9e47-49f8-8db0-97837d3fc389 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:33.724108 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b08afb-9e47-49f8-8db0-97837d3fc389 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:33.724601 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b08afb-9e47-49f8-8db0-97837d3fc389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:33.745941 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:33.746514 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-e4b08afb-9e47-49f8-8db0-97837d3fc389 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:52:33.747911 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-e4b08afb-9e47-49f8-8db0-97837d3fc389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:52:33.787531 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43022419-e00f-4628-8066-e80f2976e643 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:33.826064 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 72/136] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:52:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:52:33.827326 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189089dd-c611-4689-b167-69d2aefe3073 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:33.827608 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189089dd-c611-4689-b167-69d2aefe3073 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:33.827883 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189089dd-c611-4689-b167-69d2aefe3073 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:33.829413 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 73/137] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:52:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:52:33.830046 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189089dd-c611-4689-b167-69d2aefe3073 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:33.834822 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46cea08-70e9-4381-8828-1fd997a5458e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:33.835743 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46cea08-70e9-4381-8828-1fd997a5458e None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:33.836274 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46cea08-70e9-4381-8828-1fd997a5458e None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:33.836751 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46cea08-70e9-4381-8828-1fd997a5458e None admin] PATH_INFO: `/v3/projects/963d02180caa42f79e40d9b4e2528065` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:33.838192 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46cea08-70e9-4381-8828-1fd997a5458e None admin] RBAC: Authorizing `identity:get_project(project_id=963d02180caa42f79e40d9b4e2528065)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:33.840143 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46cea08-70e9-4381-8828-1fd997a5458e None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:33.842330 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 65/138] 10.222.0.70 () {56 vars in 1186 bytes} [Fri Aug 19 15:52:33 2022] GET /identity/v3/projects/963d02180caa42f79e40d9b4e2528065 => generated 312 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:33.848729 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662e47f-1794-408a-9235-2850dae38c7c None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:33.849203 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662e47f-1794-408a-9235-2850dae38c7c None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:33.849626 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662e47f-1794-408a-9235-2850dae38c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:33.878389 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-f662e47f-1794-408a-9235-2850dae38c7c None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:52:33.879834 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-f662e47f-1794-408a-9235-2850dae38c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:52:33.961075 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:33.987606 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189089dd-c611-4689-b167-69d2aefe3073 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:34.004476 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 66/139] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:52:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:52:34.005345 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f662e47f-1794-408a-9235-2850dae38c7c None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:34.054471 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae435620-a687-4d33-9f86-5ba6173b881f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:34.055137 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae435620-a687-4d33-9f86-5ba6173b881f None admin] REQUEST_METHOD: `PUT` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:34.057026 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae435620-a687-4d33-9f86-5ba6173b881f None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:34.057307 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae435620-a687-4d33-9f86-5ba6173b881f None admin] PATH_INFO: `/v3/projects/2e809a1a094b48538c004035badbc88e/users/39fb10cdfa334097bc6eed362d01249d/roles/2f6cb7d6ec874879972a12a63d61068d` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:34.060626 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae435620-a687-4d33-9f86-5ba6173b881f None admin] RBAC: Authorizing `identity:create_grant(project_id=2e809a1a094b48538c004035badbc88e, user_id=39fb10cdfa334097bc6eed362d01249d, role_id=2f6cb7d6ec874879972a12a63d61068d)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:34.062249 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae435620-a687-4d33-9f86-5ba6173b881f None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:34.102674 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:34.137637 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f662e47f-1794-408a-9235-2850dae38c7c None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:34.148007 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 74/140] 10.222.0.70 () {58 vars in 1439 bytes} [Fri Aug 19 15:52:33 2022] PUT /identity/v3/projects/2e809a1a094b48538c004035badbc88e/users/39fb10cdfa334097bc6eed362d01249d/roles/2f6cb7d6ec874879972a12a63d61068d => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:52:34.185442 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2209ec1-6357-46fc-b445-93fab5272a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:34.186127 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2209ec1-6357-46fc-b445-93fab5272a66 None admin] REQUEST_METHOD: `PUT` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:34.186403 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2209ec1-6357-46fc-b445-93fab5272a66 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:34.186672 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2209ec1-6357-46fc-b445-93fab5272a66 None admin] PATH_INFO: `/v3/projects/963d02180caa42f79e40d9b4e2528065/users/07c52c5ae7fc4412b1e1a11890bb9362/roles/09971bc698e84205be000073fc048af2` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:34.188778 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2209ec1-6357-46fc-b445-93fab5272a66 None admin] RBAC: Authorizing `identity:create_grant(project_id=963d02180caa42f79e40d9b4e2528065, user_id=07c52c5ae7fc4412b1e1a11890bb9362, role_id=09971bc698e84205be000073fc048af2)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:34.190240 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2209ec1-6357-46fc-b445-93fab5272a66 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:34.262396 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae435620-a687-4d33-9f86-5ba6173b881f None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:34.276547 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 67/141] 10.222.0.70 () {58 vars in 1439 bytes} [Fri Aug 19 15:52:34 2022] PUT /identity/v3/projects/963d02180caa42f79e40d9b4e2528065/users/07c52c5ae7fc4412b1e1a11890bb9362/roles/09971bc698e84205be000073fc048af2 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:52:34.425828 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae435620-a687-4d33-9f86-5ba6173b881f None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:34.473034 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9958586-5806-4299-ac9b-0151abc142f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:34.474057 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9958586-5806-4299-ac9b-0151abc142f8 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:34.474566 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9958586-5806-4299-ac9b-0151abc142f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:34.475029 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9958586-5806-4299-ac9b-0151abc142f8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:34.500257 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9958586-5806-4299-ac9b-0151abc142f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:52:34.513758 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-b9958586-5806-4299-ac9b-0151abc142f8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 15:52:34.513758 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:52:34.513758 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:52:34.513758 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:52:34.513758 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:52:34.513758 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:52:34.513758 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:52:34.513758 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:52:34.513758 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:52:34.513758 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:52:34.513758 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:52:34.513758 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:52:34.513758 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:52:34.513758 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:52:34.513758 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:52:34.513758 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:52:34.515296 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:52:34.515296 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:52:34.515296 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:52:34.515296 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:52:34.515296 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:52:34.515296 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:52:34.515296 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:52:34.515296 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:52:34.515296 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:52:34.515296 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:52:34.515296 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:52:34.515296 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:52:34.515296 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:52:34.515296 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:52:34.515296 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:52:34.515296 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:52:34.516805 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:52:34.516805 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:52:34.516805 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:52:34.516805 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:52:34.516805 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:52:34.516805 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:52:34.516805 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:52:34.516805 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:52:34.516805 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:52:34.516805 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:52:34.516805 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 15:52:34.516805 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:52:34.520056 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 75/142] 10.222.0.70 () {56 vars in 1099 bytes} [Fri Aug 19 15:52:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:52:34.529848 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2209ec1-6357-46fc-b445-93fab5272a66 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:34.627112 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9958586-5806-4299-ac9b-0151abc142f8 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:34.632817 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:34.704785 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2209ec1-6357-46fc-b445-93fab5272a66 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:34.761048 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:34.769751 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9958586-5806-4299-ac9b-0151abc142f8 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:34.773200 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d1259-bedb-4f4b-a31c-652f86bc9495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:34.773832 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d1259-bedb-4f4b-a31c-652f86bc9495 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:34.774109 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d1259-bedb-4f4b-a31c-652f86bc9495 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:34.774380 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d1259-bedb-4f4b-a31c-652f86bc9495 None admin] PATH_INFO: `/v3/roles` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:34.775933 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4d1259-bedb-4f4b-a31c-652f86bc9495 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:52:34.776238 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4d1259-bedb-4f4b-a31c-652f86bc9495 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:34.777695 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4d1259-bedb-4f4b-a31c-652f86bc9495 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:34.798010 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 68/143] 10.222.0.70 () {56 vars in 1101 bytes} [Fri Aug 19 15:52:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:34.821270 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d1259-bedb-4f4b-a31c-652f86bc9495 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:34.834897 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbed612-900e-4e5c-8239-ffec00497f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:34.835556 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbed612-900e-4e5c-8239-ffec00497f9e None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:34.835829 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbed612-900e-4e5c-8239-ffec00497f9e None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:34.836102 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbed612-900e-4e5c-8239-ffec00497f9e None admin] PATH_INFO: `/v3/domains/default` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:34.841476 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbed612-900e-4e5c-8239-ffec00497f9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:34.842964 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbed612-900e-4e5c-8239-ffec00497f9e None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:34.845011 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 76/144] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:52:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:34.850309 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbed612-900e-4e5c-8239-ffec00497f9e None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:34.942867 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:34.980281 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbed612-900e-4e5c-8239-ffec00497f9e None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:35.074034 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b7313-a9be-435c-886d-76ab6c21227b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:35.074903 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b7313-a9be-435c-886d-76ab6c21227b None admin] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:35.075321 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b7313-a9be-435c-886d-76ab6c21227b None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:35.075724 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b7313-a9be-435c-886d-76ab6c21227b None admin] PATH_INFO: `/v3/users` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:35.076510 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417b7313-a9be-435c-886d-76ab6c21227b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:35.078232 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417b7313-a9be-435c-886d-76ab6c21227b None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:35.116957 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d1259-bedb-4f4b-a31c-652f86bc9495 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:35.186801 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e0504-6412-4100-aa54-7b9eb8d9c0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:35.187679 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e0504-6412-4100-aa54-7b9eb8d9c0cb None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:35.188107 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e0504-6412-4100-aa54-7b9eb8d9c0cb None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:35.188586 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e0504-6412-4100-aa54-7b9eb8d9c0cb None admin] PATH_INFO: `/v3/users/079333c22795432e83a2d1a50caec117` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:35.193346 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6e0504-6412-4100-aa54-7b9eb8d9c0cb None admin] RBAC: Authorizing `identity:get_user(user_id=079333c22795432e83a2d1a50caec117)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:35.194943 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6e0504-6412-4100-aa54-7b9eb8d9c0cb None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:35.196763 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 69/145] 10.222.0.70 () {56 vars in 1177 bytes} [Fri Aug 19 15:52:34 2022] GET /identity/v3/users/079333c22795432e83a2d1a50caec117 => generated 289 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:52:35.200154 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 77/146] 10.222.0.70 () {60 vars in 1132 bytes} [Fri Aug 19 15:52:34 2022] POST /identity/v3/users => generated 283 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:52:35.205584 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e0504-6412-4100-aa54-7b9eb8d9c0cb None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:35.291423 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:35.351524 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e0504-6412-4100-aa54-7b9eb8d9c0cb None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:35.406961 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea749fef-bc53-4c8b-8894-b0beb99aa9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:35.407614 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea749fef-bc53-4c8b-8894-b0beb99aa9e3 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:35.407892 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea749fef-bc53-4c8b-8894-b0beb99aa9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:35.408162 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea749fef-bc53-4c8b-8894-b0beb99aa9e3 None admin] PATH_INFO: `/v3/projects/2e809a1a094b48538c004035badbc88e` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:35.413562 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea749fef-bc53-4c8b-8894-b0beb99aa9e3 None admin] RBAC: Authorizing `identity:get_project(project_id=2e809a1a094b48538c004035badbc88e)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:35.415066 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea749fef-bc53-4c8b-8894-b0beb99aa9e3 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:35.418092 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 70/147] 10.222.0.70 () {56 vars in 1186 bytes} [Fri Aug 19 15:52:35 2022] GET /identity/v3/projects/2e809a1a094b48538c004035badbc88e => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:35.429817 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b7313-a9be-435c-886d-76ab6c21227b None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:35.592709 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b7313-a9be-435c-886d-76ab6c21227b None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:35.632225 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:35.641491 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90bf2f-2ee5-4563-ab6a-24975d943a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:35.645163 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90bf2f-2ee5-4563-ab6a-24975d943a47 None admin] REQUEST_METHOD: `PUT` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:35.645163 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90bf2f-2ee5-4563-ab6a-24975d943a47 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:35.645163 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90bf2f-2ee5-4563-ab6a-24975d943a47 None admin] PATH_INFO: `/v3/projects/2e809a1a094b48538c004035badbc88e/users/079333c22795432e83a2d1a50caec117/roles/2e3dded4c3734675b1978c6f9ec33c7b` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:35.647045 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a90bf2f-2ee5-4563-ab6a-24975d943a47 None admin] RBAC: Authorizing `identity:create_grant(project_id=2e809a1a094b48538c004035badbc88e, user_id=079333c22795432e83a2d1a50caec117, role_id=2e3dded4c3734675b1978c6f9ec33c7b)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:35.648604 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a90bf2f-2ee5-4563-ab6a-24975d943a47 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:35.746393 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 78/148] 10.222.0.70 () {58 vars in 1439 bytes} [Fri Aug 19 15:52:35 2022] PUT /identity/v3/projects/2e809a1a094b48538c004035badbc88e/users/079333c22795432e83a2d1a50caec117/roles/2e3dded4c3734675b1978c6f9ec33c7b => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:52:36.875635 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616047c7-dcf6-4aca-9198-bd756d43a0df None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:36.876367 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616047c7-dcf6-4aca-9198-bd756d43a0df None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:36.876367 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616047c7-dcf6-4aca-9198-bd756d43a0df None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:36.878064 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 71/149] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:52:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:52:36.884068 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9156197-597f-4ddc-acb9-92dcc5ee90d5 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:36.884773 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9156197-597f-4ddc-acb9-92dcc5ee90d5 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:36.884896 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9156197-597f-4ddc-acb9-92dcc5ee90d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:36.913041 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-a9156197-597f-4ddc-acb9-92dcc5ee90d5 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:52:36.914247 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-a9156197-597f-4ddc-acb9-92dcc5ee90d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:52:37.011960 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 79/150] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:52:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:52:37.110675 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d5bf5-982d-4d65-a57a-362aae4c01c7 None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:37.111081 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d5bf5-982d-4d65-a57a-362aae4c01c7 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:37.111226 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d5bf5-982d-4d65-a57a-362aae4c01c7 None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:37.112892 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 72/151] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:52:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:52:37.118483 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438e10a-103c-46d3-a185-17d88e81c717 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:37.119643 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438e10a-103c-46d3-a185-17d88e81c717 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:37.119894 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438e10a-103c-46d3-a185-17d88e81c717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:37.144119 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-6438e10a-103c-46d3-a185-17d88e81c717 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:52:37.145237 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-6438e10a-103c-46d3-a185-17d88e81c717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:52:37.239248 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 80/152] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:52:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 15:52:37.457412 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93ebcb-bf5e-4cb9-afee-0c23c3b85c2f None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:37.457822 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93ebcb-bf5e-4cb9-afee-0c23c3b85c2f None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:37.457964 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93ebcb-bf5e-4cb9-afee-0c23c3b85c2f None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:37.459388 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 73/153] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:52:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 15:52:37.466923 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c4e51-61c7-453c-b944-cd0d574f57d5 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:37.467253 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c4e51-61c7-453c-b944-cd0d574f57d5 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:37.467502 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c4e51-61c7-453c-b944-cd0d574f57d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:37.493698 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-ee4c4e51-61c7-453c-b944-cd0d574f57d5 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:52:37.495258 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-ee4c4e51-61c7-453c-b944-cd0d574f57d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:52:37.546875 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:37.579038 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 81/154] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:52:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:52:37.990249 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c93ebcb-bf5e-4cb9-afee-0c23c3b85c2f None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:38.101759 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c4e51-61c7-453c-b944-cd0d574f57d5 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:38.132833 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c93ebcb-bf5e-4cb9-afee-0c23c3b85c2f None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:38.181753 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:38.190053 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23024d-485c-447b-89a5-b298015a3e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:38.190861 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23024d-485c-447b-89a5-b298015a3e53 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:38.191148 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23024d-485c-447b-89a5-b298015a3e53 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:38.191421 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23024d-485c-447b-89a5-b298015a3e53 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:38.208492 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f23024d-485c-447b-89a5-b298015a3e53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:52:38.214784 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-9f23024d-485c-447b-89a5-b298015a3e53 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 15:52:38.214784 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:52:38.214784 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:52:38.214784 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:52:38.214784 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:52:38.214784 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:52:38.214784 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:52:38.214784 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:52:38.214784 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:52:38.214784 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:52:38.214784 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:52:38.214784 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:52:38.214784 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:52:38.214784 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:52:38.214784 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:52:38.214784 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:52:38.217846 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:52:38.217846 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:52:38.217846 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:52:38.217846 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:52:38.217846 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:52:38.217846 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:52:38.217846 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:52:38.217846 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:52:38.217846 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:52:38.217846 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:52:38.217846 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:52:38.217846 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:52:38.217846 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:52:38.217846 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:52:38.217846 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:52:38.217846 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:52:38.220733 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:52:38.220733 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:52:38.220733 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:52:38.220733 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:52:38.220733 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:52:38.220733 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:52:38.220733 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:52:38.220733 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:52:38.220733 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:52:38.220733 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:52:38.220733 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 15:52:38.220733 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:52:38.228809 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 74/155] 10.222.0.70 () {56 vars in 1114 bytes} [Fri Aug 19 15:52:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:52:38.228809 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23024d-485c-447b-89a5-b298015a3e53 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:38.341767 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c4e51-61c7-453c-b944-cd0d574f57d5 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:38.404728 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022c4f44-892b-4c80-a175-1563428a823d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:38.405460 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c4f44-892b-4c80-a175-1563428a823d None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:38.405735 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c4f44-892b-4c80-a175-1563428a823d None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:38.406004 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c4f44-892b-4c80-a175-1563428a823d None admin] PATH_INFO: `/v3/roles/member` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:38.417023 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022c4f44-892b-4c80-a175-1563428a823d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:52:38.421746 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-022c4f44-892b-4c80-a175-1563428a823d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:52:38.421746 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:52:38.421746 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:52:38.421746 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:52:38.421746 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:52:38.421746 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:52:38.421746 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:52:38.421746 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:52:38.421746 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:52:38.421746 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:52:38.421746 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:52:38.421746 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:52:38.421746 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:52:38.421746 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:52:38.421746 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:52:38.421746 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:52:38.423261 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:52:38.423261 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:52:38.423261 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:52:38.423261 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:52:38.423261 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:52:38.423261 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:52:38.423261 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:52:38.423261 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:52:38.423261 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:52:38.423261 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:52:38.423261 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:52:38.423261 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:52:38.423261 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:52:38.423261 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:52:38.423261 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:52:38.423261 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:52:38.425409 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:52:38.425409 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:52:38.425409 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:52:38.425409 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:52:38.425409 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:52:38.425409 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:52:38.425409 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:52:38.425409 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:52:38.425409 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:52:38.425409 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:52:38.425409 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:52:38.425409 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:52:38.430292 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 82/156] 10.222.0.70 () {56 vars in 1099 bytes} [Fri Aug 19 15:52:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:52:38.431992 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022c4f44-892b-4c80-a175-1563428a823d None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:38.432362 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23024d-485c-447b-89a5-b298015a3e53 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:38.487681 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593221a9-ee41-4c63-94a5-fe6d952826bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:38.488295 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593221a9-ee41-4c63-94a5-fe6d952826bc None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:38.488574 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593221a9-ee41-4c63-94a5-fe6d952826bc None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:38.493006 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593221a9-ee41-4c63-94a5-fe6d952826bc None admin] PATH_INFO: `/v3/roles` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:38.494514 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593221a9-ee41-4c63-94a5-fe6d952826bc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:52:38.494843 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593221a9-ee41-4c63-94a5-fe6d952826bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:38.496206 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593221a9-ee41-4c63-94a5-fe6d952826bc None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:38.506460 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:38.511099 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 75/157] 10.222.0.70 () {56 vars in 1111 bytes} [Fri Aug 19 15:52:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:38.511963 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593221a9-ee41-4c63-94a5-fe6d952826bc None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:38.613308 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022c4f44-892b-4c80-a175-1563428a823d None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:38.655644 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:38.672113 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd51a17-111e-4263-9ba6-fbb5ba3996b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:38.672754 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd51a17-111e-4263-9ba6-fbb5ba3996b5 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:38.673041 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd51a17-111e-4263-9ba6-fbb5ba3996b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:38.673298 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd51a17-111e-4263-9ba6-fbb5ba3996b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:38.691244 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd51a17-111e-4263-9ba6-fbb5ba3996b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:52:38.704263 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-1cd51a17-111e-4263-9ba6-fbb5ba3996b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:52:38.704263 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:52:38.704263 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:52:38.704263 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:52:38.704263 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:52:38.704263 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:52:38.704263 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:52:38.704263 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:52:38.704263 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:52:38.704263 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:52:38.704263 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:52:38.704263 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:52:38.704263 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:52:38.704263 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:52:38.704263 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:52:38.704263 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:52:38.705256 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:52:38.705256 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:52:38.705256 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:52:38.705256 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:52:38.705256 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:52:38.705256 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:52:38.705256 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:52:38.705256 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:52:38.705256 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:52:38.705256 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:52:38.705256 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:52:38.705256 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:52:38.705256 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:52:38.705256 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:52:38.705256 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:52:38.705256 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:52:38.706066 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:52:38.706066 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:52:38.706066 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:52:38.706066 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:52:38.706066 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:52:38.706066 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:52:38.706066 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:52:38.706066 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:52:38.706066 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:52:38.706066 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:52:38.706066 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:52:38.706066 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:52:38.706066 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 83/158] 10.222.0.70 () {56 vars in 1096 bytes} [Fri Aug 19 15:52:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:52:38.709617 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd51a17-111e-4263-9ba6-fbb5ba3996b5 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:38.725970 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593221a9-ee41-4c63-94a5-fe6d952826bc None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:38.761512 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feba2d3-a922-450b-a887-9d35133bfeda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:38.762128 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feba2d3-a922-450b-a887-9d35133bfeda None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:38.762404 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feba2d3-a922-450b-a887-9d35133bfeda None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:38.762671 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feba2d3-a922-450b-a887-9d35133bfeda None admin] PATH_INFO: `/v3/roles` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:38.763332 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feba2d3-a922-450b-a887-9d35133bfeda None admin] RBAC: Adding query filter params (name=member) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:52:38.763628 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feba2d3-a922-450b-a887-9d35133bfeda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:38.765018 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feba2d3-a922-450b-a887-9d35133bfeda None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:38.774319 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 76/159] 10.222.0.70 () {56 vars in 1101 bytes} [Fri Aug 19 15:52:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:38.775893 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feba2d3-a922-450b-a887-9d35133bfeda None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:38.892007 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:38.896855 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd51a17-111e-4263-9ba6-fbb5ba3996b5 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:38.898228 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feba2d3-a922-450b-a887-9d35133bfeda None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:38.913348 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:38.936907 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71f662-2918-4a86-a27a-18e03879b1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:38.937518 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71f662-2918-4a86-a27a-18e03879b1a4 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:38.937790 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71f662-2918-4a86-a27a-18e03879b1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:38.938058 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71f662-2918-4a86-a27a-18e03879b1a4 None admin] PATH_INFO: `/v3/roles` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:38.938726 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71f662-2918-4a86-a27a-18e03879b1a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:52:38.939026 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71f662-2918-4a86-a27a-18e03879b1a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:38.941011 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71f662-2918-4a86-a27a-18e03879b1a4 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:38.950350 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 77/160] 10.222.0.70 () {56 vars in 1099 bytes} [Fri Aug 19 15:52:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:38.951185 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71f662-2918-4a86-a27a-18e03879b1a4 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:38.971222 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c19e2cc-3b43-43da-9e04-9c811d86dae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:38.972275 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c19e2cc-3b43-43da-9e04-9c811d86dae6 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:38.972799 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c19e2cc-3b43-43da-9e04-9c811d86dae6 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:38.973266 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c19e2cc-3b43-43da-9e04-9c811d86dae6 None admin] PATH_INFO: `/v3/users/07c52c5ae7fc4412b1e1a11890bb9362` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:38.977461 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c19e2cc-3b43-43da-9e04-9c811d86dae6 None admin] RBAC: Authorizing `identity:get_user(user_id=07c52c5ae7fc4412b1e1a11890bb9362)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:38.979903 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c19e2cc-3b43-43da-9e04-9c811d86dae6 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:38.981998 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 84/161] 10.222.0.70 () {56 vars in 1177 bytes} [Fri Aug 19 15:52:38 2022] GET /identity/v3/users/07c52c5ae7fc4412b1e1a11890bb9362 => generated 275 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:38.983092 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c19e2cc-3b43-43da-9e04-9c811d86dae6 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:39.065688 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71f662-2918-4a86-a27a-18e03879b1a4 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:39.107091 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a18670-4c41-4b00-9063-c3b4571a85db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:39.107726 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a18670-4c41-4b00-9063-c3b4571a85db None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:39.107997 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a18670-4c41-4b00-9063-c3b4571a85db None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:39.108265 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a18670-4c41-4b00-9063-c3b4571a85db None admin] PATH_INFO: `/v3/users/07c52c5ae7fc4412b1e1a11890bb9362` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:39.109462 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a18670-4c41-4b00-9063-c3b4571a85db None admin] RBAC: Authorizing `identity:get_user(user_id=07c52c5ae7fc4412b1e1a11890bb9362)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:39.112844 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a18670-4c41-4b00-9063-c3b4571a85db None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:39.112844 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 78/162] 10.222.0.70 () {56 vars in 1177 bytes} [Fri Aug 19 15:52:38 2022] GET /identity/v3/users/07c52c5ae7fc4412b1e1a11890bb9362 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:39.113631 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a18670-4c41-4b00-9063-c3b4571a85db None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:39.167004 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:39.177913 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c19e2cc-3b43-43da-9e04-9c811d86dae6 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:39.235628 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a18670-4c41-4b00-9063-c3b4571a85db None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:39.246379 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc140f7-684d-4c48-94c3-0c5cec7c8830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:39.247028 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc140f7-684d-4c48-94c3-0c5cec7c8830 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:39.247299 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc140f7-684d-4c48-94c3-0c5cec7c8830 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:39.247565 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc140f7-684d-4c48-94c3-0c5cec7c8830 None admin] PATH_INFO: `/v3/users/39fb10cdfa334097bc6eed362d01249d` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:39.253552 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc140f7-684d-4c48-94c3-0c5cec7c8830 None admin] RBAC: Authorizing `identity:get_user(user_id=39fb10cdfa334097bc6eed362d01249d)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:39.255051 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc140f7-684d-4c48-94c3-0c5cec7c8830 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:39.257124 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 85/163] 10.222.0.70 () {56 vars in 1177 bytes} [Fri Aug 19 15:52:38 2022] GET /identity/v3/users/39fb10cdfa334097bc6eed362d01249d => generated 247 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:39.258015 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc140f7-684d-4c48-94c3-0c5cec7c8830 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:39.280630 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6513cf84-5be9-483c-b9db-2ab43c60f4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:39.281321 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513cf84-5be9-483c-b9db-2ab43c60f4c6 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:39.281594 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513cf84-5be9-483c-b9db-2ab43c60f4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:39.281939 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513cf84-5be9-483c-b9db-2ab43c60f4c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:39.319449 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:39.387331 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6513cf84-5be9-483c-b9db-2ab43c60f4c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:39.389123 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6513cf84-5be9-483c-b9db-2ab43c60f4c6 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:39.440739 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:39.503071 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 79/164] 10.222.0.70 () {58 vars in 1282 bytes} [Fri Aug 19 15:52:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:52:39.504375 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6513cf84-5be9-483c-b9db-2ab43c60f4c6 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:39.548640 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc140f7-684d-4c48-94c3-0c5cec7c8830 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:39.621943 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48efb8d0-aec1-4b28-8707-ffe87e8d4b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:39.622937 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48efb8d0-aec1-4b28-8707-ffe87e8d4b4a None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:39.623407 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48efb8d0-aec1-4b28-8707-ffe87e8d4b4a None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:39.623865 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48efb8d0-aec1-4b28-8707-ffe87e8d4b4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:39.703958 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48efb8d0-aec1-4b28-8707-ffe87e8d4b4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:39.706290 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48efb8d0-aec1-4b28-8707-ffe87e8d4b4a None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:39.754290 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:39.760794 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6513cf84-5be9-483c-b9db-2ab43c60f4c6 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:39.804621 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805eaf40-97b3-41c1-ba04-3860148ecb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:39.805262 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805eaf40-97b3-41c1-ba04-3860148ecb7c None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:39.805542 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805eaf40-97b3-41c1-ba04-3860148ecb7c None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:39.805858 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805eaf40-97b3-41c1-ba04-3860148ecb7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:39.823766 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:39.841288 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 86/165] 10.222.0.70 () {58 vars in 1282 bytes} [Fri Aug 19 15:52:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:52:39.843045 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48efb8d0-aec1-4b28-8707-ffe87e8d4b4a None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:39.901552 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805eaf40-97b3-41c1-ba04-3860148ecb7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:39.903110 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805eaf40-97b3-41c1-ba04-3860148ecb7c None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:40.008402 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48efb8d0-aec1-4b28-8707-ffe87e8d4b4a None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:40.065723 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 80/166] 10.222.0.70 () {58 vars in 1282 bytes} [Fri Aug 19 15:52:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:52:40.067000 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeff390-b7ab-4dc6-a6fe-bfc43835dd8e None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:40.067281 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeff390-b7ab-4dc6-a6fe-bfc43835dd8e None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:40.067553 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeff390-b7ab-4dc6-a6fe-bfc43835dd8e None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:40.068895 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 81/167] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:52:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:52:40.069806 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeff390-b7ab-4dc6-a6fe-bfc43835dd8e None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:40.070331 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba57b53-8595-43ae-aff3-6858a620c7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:40.070920 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba57b53-8595-43ae-aff3-6858a620c7a9 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:40.071199 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba57b53-8595-43ae-aff3-6858a620c7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:40.071476 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba57b53-8595-43ae-aff3-6858a620c7a9 None admin] PATH_INFO: `/v3/projects/2e809a1a094b48538c004035badbc88e` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:40.077431 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba57b53-8595-43ae-aff3-6858a620c7a9 None admin] RBAC: Authorizing `identity:get_project(project_id=2e809a1a094b48538c004035badbc88e)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:40.078916 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba57b53-8595-43ae-aff3-6858a620c7a9 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:40.080780 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 87/168] 10.222.0.70 () {56 vars in 1186 bytes} [Fri Aug 19 15:52:39 2022] GET /identity/v3/projects/2e809a1a094b48538c004035badbc88e => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:40.081674 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba57b53-8595-43ae-aff3-6858a620c7a9 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:40.084707 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:40.124293 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:40.277216 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeff390-b7ab-4dc6-a6fe-bfc43835dd8e None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:40.288433 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba57b53-8595-43ae-aff3-6858a620c7a9 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:40.325972 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f8db9-95b3-46e1-9db1-e5d76d26c3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:40.327028 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f8db9-95b3-46e1-9db1-e5d76d26c3bc None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:40.327639 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f8db9-95b3-46e1-9db1-e5d76d26c3bc None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:40.328108 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f8db9-95b3-46e1-9db1-e5d76d26c3bc None admin] PATH_INFO: `/v3/projects/2e809a1a094b48538c004035badbc88e` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:40.329542 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2f8db9-95b3-46e1-9db1-e5d76d26c3bc None admin] RBAC: Authorizing `identity:get_project(project_id=2e809a1a094b48538c004035badbc88e)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:40.331215 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2f8db9-95b3-46e1-9db1-e5d76d26c3bc None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:40.333429 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 88/169] 10.222.0.70 () {56 vars in 1186 bytes} [Fri Aug 19 15:52:40 2022] GET /identity/v3/projects/2e809a1a094b48538c004035badbc88e => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:40.334864 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184011b4-fc4f-4554-bef3-614226c649f9 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:40.335345 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184011b4-fc4f-4554-bef3-614226c649f9 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:40.335810 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184011b4-fc4f-4554-bef3-614226c649f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:40.346904 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81f57e-cd97-403b-9cc9-7c7170ed8e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:40.347552 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81f57e-cd97-403b-9cc9-7c7170ed8e15 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:40.347951 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81f57e-cd97-403b-9cc9-7c7170ed8e15 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:40.348243 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81f57e-cd97-403b-9cc9-7c7170ed8e15 None admin] PATH_INFO: `/v3/projects/2e809a1a094b48538c004035badbc88e` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:40.352168 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e81f57e-cd97-403b-9cc9-7c7170ed8e15 None admin] RBAC: Authorizing `identity:get_project(project_id=2e809a1a094b48538c004035badbc88e)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:40.353764 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e81f57e-cd97-403b-9cc9-7c7170ed8e15 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:40.355556 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 82/170] 10.222.0.70 () {56 vars in 1186 bytes} [Fri Aug 19 15:52:40 2022] GET /identity/v3/projects/2e809a1a094b48538c004035badbc88e => generated 298 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:40.356214 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81f57e-cd97-403b-9cc9-7c7170ed8e15 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:40.358856 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-184011b4-fc4f-4554-bef3-614226c649f9 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:52:40.360282 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-184011b4-fc4f-4554-bef3-614226c649f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:52:40.429474 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:40.435795 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 89/171] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:52:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:52:40.436801 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184011b4-fc4f-4554-bef3-614226c649f9 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:40.546358 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184011b4-fc4f-4554-bef3-614226c649f9 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:40.550389 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81f57e-cd97-403b-9cc9-7c7170ed8e15 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:40.569787 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:40.583844 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04c214c-dc24-4c74-bc56-b54aa4e00ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:40.584602 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c214c-dc24-4c74-bc56-b54aa4e00ac9 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:40.584998 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c214c-dc24-4c74-bc56-b54aa4e00ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:40.585365 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c214c-dc24-4c74-bc56-b54aa4e00ac9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:40.586215 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04c214c-dc24-4c74-bc56-b54aa4e00ac9 None admin] RBAC: Adding query filter params (role.id=2f6cb7d6ec874879972a12a63d61068d, scope.project.id=2e809a1a094b48538c004035badbc88e, user.id=39fb10cdfa334097bc6eed362d01249d) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:52:40.587029 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04c214c-dc24-4c74-bc56-b54aa4e00ac9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:40.589165 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04c214c-dc24-4c74-bc56-b54aa4e00ac9 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:40.596465 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 90/172] 10.222.0.70 () {56 vars in 1374 bytes} [Fri Aug 19 15:52:40 2022] GET /identity/v3/role_assignments?user.id=39fb10cdfa334097bc6eed362d01249d&scope.project.id=2e809a1a094b48538c004035badbc88e&role.id=2f6cb7d6ec874879972a12a63d61068d => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:40.597428 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04c214c-dc24-4c74-bc56-b54aa4e00ac9 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:40.641325 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09562e6-3950-470c-802c-b3d59c749e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:40.642221 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09562e6-3950-470c-802c-b3d59c749e4e None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:40.642649 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09562e6-3950-470c-802c-b3d59c749e4e None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:40.643061 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09562e6-3950-470c-802c-b3d59c749e4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:40.643935 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09562e6-3950-470c-802c-b3d59c749e4e None admin] RBAC: Adding query filter params (role.id=294bcd6132ef46d48aff3efa4d77fa0a, scope.project.id=2e809a1a094b48538c004035badbc88e, user.id=07c52c5ae7fc4412b1e1a11890bb9362) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:52:40.644384 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09562e6-3950-470c-802c-b3d59c749e4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:40.646291 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09562e6-3950-470c-802c-b3d59c749e4e None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:40.658679 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 83/173] 10.222.0.70 () {56 vars in 1374 bytes} [Fri Aug 19 15:52:40 2022] GET /identity/v3/role_assignments?user.id=07c52c5ae7fc4412b1e1a11890bb9362&scope.project.id=2e809a1a094b48538c004035badbc88e&role.id=294bcd6132ef46d48aff3efa4d77fa0a => generated 608 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:40.672331 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:40.717969 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04c214c-dc24-4c74-bc56-b54aa4e00ac9 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:40.761570 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3922faaa-9add-4a07-847d-98c8030e5350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:40.762190 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922faaa-9add-4a07-847d-98c8030e5350 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:40.762465 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922faaa-9add-4a07-847d-98c8030e5350 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:40.762805 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922faaa-9add-4a07-847d-98c8030e5350 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:40.763543 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3922faaa-9add-4a07-847d-98c8030e5350 None admin] RBAC: Adding query filter params (role.id=09971bc698e84205be000073fc048af2, scope.project.id=2e809a1a094b48538c004035badbc88e, user.id=07c52c5ae7fc4412b1e1a11890bb9362) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:52:40.763847 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3922faaa-9add-4a07-847d-98c8030e5350 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:40.765347 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3922faaa-9add-4a07-847d-98c8030e5350 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:40.772192 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 91/174] 10.222.0.70 () {56 vars in 1374 bytes} [Fri Aug 19 15:52:40 2022] GET /identity/v3/role_assignments?user.id=07c52c5ae7fc4412b1e1a11890bb9362&scope.project.id=2e809a1a094b48538c004035badbc88e&role.id=09971bc698e84205be000073fc048af2 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:41.088049 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566487b-f36d-4f25-b2f9-8d89e148112a None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:41.088577 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566487b-f36d-4f25-b2f9-8d89e148112a None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:41.088577 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566487b-f36d-4f25-b2f9-8d89e148112a None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:41.090145 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 84/175] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:52:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:52:41.097405 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dcb2e2-274b-4a76-a030-d419eb2c78b0 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:41.097997 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dcb2e2-274b-4a76-a030-d419eb2c78b0 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:41.098495 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dcb2e2-274b-4a76-a030-d419eb2c78b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:41.121274 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-08dcb2e2-274b-4a76-a030-d419eb2c78b0 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:52:41.122859 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-08dcb2e2-274b-4a76-a030-d419eb2c78b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:52:41.202413 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 92/176] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:52:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:52:41.274269 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6566487b-f36d-4f25-b2f9-8d89e148112a None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:41.415093 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6566487b-f36d-4f25-b2f9-8d89e148112a None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:41.467904 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff7a4ee-79e0-4074-a87b-882616a60f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:41.468553 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff7a4ee-79e0-4074-a87b-882616a60f74 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:41.468855 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff7a4ee-79e0-4074-a87b-882616a60f74 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:41.469124 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff7a4ee-79e0-4074-a87b-882616a60f74 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:41.485799 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff7a4ee-79e0-4074-a87b-882616a60f74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:52:41.490719 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-fff7a4ee-79e0-4074-a87b-882616a60f74 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:52:41.490719 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:52:41.490719 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:52:41.490719 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:52:41.490719 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:52:41.490719 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:52:41.490719 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:52:41.490719 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:52:41.490719 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:52:41.490719 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:52:41.490719 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:52:41.490719 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:52:41.490719 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:52:41.490719 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:52:41.490719 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:52:41.490719 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:52:41.491652 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:52:41.491652 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:52:41.491652 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:52:41.491652 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:52:41.491652 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:52:41.491652 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:52:41.491652 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:52:41.491652 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:52:41.491652 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:52:41.491652 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:52:41.491652 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:52:41.491652 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:52:41.491652 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:52:41.491652 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:52:41.491652 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:52:41.491652 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:52:41.492438 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:52:41.492438 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:52:41.492438 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:52:41.492438 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:52:41.492438 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:52:41.492438 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:52:41.492438 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:52:41.492438 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:52:41.492438 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:52:41.492438 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:52:41.492438 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:52:41.492438 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:52:41.492438 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 85/177] 10.222.0.70 () {56 vars in 1099 bytes} [Fri Aug 19 15:52:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:52:41.503310 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dcb2e2-274b-4a76-a030-d419eb2c78b0 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:41.598703 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:41.656172 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff7a4ee-79e0-4074-a87b-882616a60f74 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:41.657163 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dcb2e2-274b-4a76-a030-d419eb2c78b0 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:41.703165 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c837aabb-8c1e-4adf-afd1-06fa3750e243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:41.703795 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c837aabb-8c1e-4adf-afd1-06fa3750e243 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:41.704075 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c837aabb-8c1e-4adf-afd1-06fa3750e243 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:41.704349 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c837aabb-8c1e-4adf-afd1-06fa3750e243 None admin] PATH_INFO: `/v3/roles` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:41.705103 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c837aabb-8c1e-4adf-afd1-06fa3750e243 None admin] RBAC: Adding query filter params (name=member) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:52:41.705406 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c837aabb-8c1e-4adf-afd1-06fa3750e243 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:41.706978 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c837aabb-8c1e-4adf-afd1-06fa3750e243 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:41.716057 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:41.717816 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 93/178] 10.222.0.70 () {56 vars in 1101 bytes} [Fri Aug 19 15:52:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:41.718131 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce9a3d-dafb-472b-9a1c-b5f5c03b542e None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:41.720712 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce9a3d-dafb-472b-9a1c-b5f5c03b542e None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:41.720712 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce9a3d-dafb-472b-9a1c-b5f5c03b542e None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:41.720712 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 94/179] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:52:41.721196 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74348998-3181-4631-8669-a74796a3615a None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:41.721531 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74348998-3181-4631-8669-a74796a3615a None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:41.721811 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74348998-3181-4631-8669-a74796a3615a None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:41.723026 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 95/180] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:52:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:52:41.727871 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74348998-3181-4631-8669-a74796a3615a None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:41.799921 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff7a4ee-79e0-4074-a87b-882616a60f74 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:41.837884 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d1558d-2abf-4552-b7d3-222fc42bef1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:41.838622 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1558d-2abf-4552-b7d3-222fc42bef1b None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:41.839009 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1558d-2abf-4552-b7d3-222fc42bef1b None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:41.839346 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1558d-2abf-4552-b7d3-222fc42bef1b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:41.841160 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74348998-3181-4631-8669-a74796a3615a None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:41.850109 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d1558d-2abf-4552-b7d3-222fc42bef1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:52:41.855734 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-b4d1558d-2abf-4552-b7d3-222fc42bef1b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 15:52:41.855734 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:52:41.855734 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:52:41.855734 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:52:41.855734 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:52:41.855734 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:52:41.855734 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:52:41.855734 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:52:41.855734 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:52:41.855734 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:52:41.855734 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:52:41.855734 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:52:41.855734 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:52:41.855734 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:52:41.855734 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:52:41.855734 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:52:41.856614 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:52:41.856614 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:52:41.856614 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:52:41.856614 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:52:41.856614 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:52:41.856614 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:52:41.856614 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:52:41.856614 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:52:41.856614 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:52:41.856614 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:52:41.856614 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:52:41.856614 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:52:41.856614 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:52:41.856614 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:52:41.856614 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:52:41.856614 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:52:41.861626 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:52:41.861626 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:52:41.861626 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:52:41.861626 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:52:41.861626 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:52:41.861626 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:52:41.861626 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:52:41.861626 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:52:41.861626 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:52:41.861626 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:52:41.861626 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 15:52:41.861626 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:52:41.861626 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 86/181] 10.222.0.70 () {56 vars in 1099 bytes} [Fri Aug 19 15:52:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:52:41.861626 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1199bf5-da7d-4a04-b1c9-38b9a6bc11da None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:41.862343 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1199bf5-da7d-4a04-b1c9-38b9a6bc11da None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:41.862343 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1199bf5-da7d-4a04-b1c9-38b9a6bc11da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:41.869759 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:41.877392 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-c1199bf5-da7d-4a04-b1c9-38b9a6bc11da None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:52:41.878564 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-c1199bf5-da7d-4a04-b1c9-38b9a6bc11da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:52:41.883626 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6308be-11c6-4c85-a449-5f96a4747800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:41.884287 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6308be-11c6-4c85-a449-5f96a4747800 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:41.884566 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6308be-11c6-4c85-a449-5f96a4747800 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:41.884869 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6308be-11c6-4c85-a449-5f96a4747800 None admin] PATH_INFO: `/v3/users/07c52c5ae7fc4412b1e1a11890bb9362` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:41.886003 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6308be-11c6-4c85-a449-5f96a4747800 None admin] RBAC: Authorizing `identity:get_user(user_id=07c52c5ae7fc4412b1e1a11890bb9362)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:41.887456 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6308be-11c6-4c85-a449-5f96a4747800 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:41.889077 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 96/182] 10.222.0.70 () {56 vars in 1177 bytes} [Fri Aug 19 15:52:41 2022] GET /identity/v3/users/07c52c5ae7fc4412b1e1a11890bb9362 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:41.890193 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d95a67-f08b-426a-816c-aa730063395b None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:41.890471 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d95a67-f08b-426a-816c-aa730063395b None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:41.890758 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d95a67-f08b-426a-816c-aa730063395b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:41.909600 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-56d95a67-f08b-426a-816c-aa730063395b None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:52:41.910694 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-56d95a67-f08b-426a-816c-aa730063395b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:52:41.950377 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 87/183] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:52:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:52:41.952241 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1199bf5-da7d-4a04-b1c9-38b9a6bc11da None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:41.980453 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 97/184] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:52:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:52:41.982096 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72504adc-6590-42ce-a4bd-327904fae5ca None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:41.982454 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72504adc-6590-42ce-a4bd-327904fae5ca None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:41.982800 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72504adc-6590-42ce-a4bd-327904fae5ca None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:41.984257 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 98/185] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:52:41.988712 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72504adc-6590-42ce-a4bd-327904fae5ca None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:42.000358 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:42.107648 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72504adc-6590-42ce-a4bd-327904fae5ca None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:42.108717 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1199bf5-da7d-4a04-b1c9-38b9a6bc11da None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:42.127861 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:42.146346 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8e24e-f6e0-46bc-8c84-045f6016628c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:42.147078 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8e24e-f6e0-46bc-8c84-045f6016628c None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:42.147356 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8e24e-f6e0-46bc-8c84-045f6016628c None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:42.147615 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8e24e-f6e0-46bc-8c84-045f6016628c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:42.157638 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9503b04-adbc-4729-9ecf-b49f1f9ce31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:42.158510 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9503b04-adbc-4729-9ecf-b49f1f9ce31e None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:42.159353 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9503b04-adbc-4729-9ecf-b49f1f9ce31e None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:42.159874 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9503b04-adbc-4729-9ecf-b49f1f9ce31e None admin] PATH_INFO: `/v3/roles` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:42.161019 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9503b04-adbc-4729-9ecf-b49f1f9ce31e None admin] RBAC: Adding query filter params (name=reader) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:52:42.161335 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9503b04-adbc-4729-9ecf-b49f1f9ce31e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:42.162792 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9503b04-adbc-4729-9ecf-b49f1f9ce31e None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:42.177746 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 88/186] 10.222.0.70 () {56 vars in 1101 bytes} [Fri Aug 19 15:52:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:42.179948 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994bfd3a-12a0-451b-a43c-483058c099ab None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:42.180694 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994bfd3a-12a0-451b-a43c-483058c099ab None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:42.182243 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994bfd3a-12a0-451b-a43c-483058c099ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:42.204107 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-994bfd3a-12a0-451b-a43c-483058c099ab None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:52:42.205422 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-994bfd3a-12a0-451b-a43c-483058c099ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:52:42.239628 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d8e24e-f6e0-46bc-8c84-045f6016628c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:42.241647 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d8e24e-f6e0-46bc-8c84-045f6016628c None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:42.284695 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 89/187] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:52:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:52:42.284695 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994bfd3a-12a0-451b-a43c-483058c099ab None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:42.310795 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:42.391765 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 99/188] 10.222.0.70 () {58 vars in 1282 bytes} [Fri Aug 19 15:52:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:52:42.392895 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8e24e-f6e0-46bc-8c84-045f6016628c None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:42.402955 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994bfd3a-12a0-451b-a43c-483058c099ab None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:42.414083 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:42.441381 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da12fcad-8df8-40ad-9f75-892a5c483245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:42.442012 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da12fcad-8df8-40ad-9f75-892a5c483245 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:42.442280 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da12fcad-8df8-40ad-9f75-892a5c483245 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:42.442544 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da12fcad-8df8-40ad-9f75-892a5c483245 None admin] PATH_INFO: `/v3/users/079333c22795432e83a2d1a50caec117` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:42.443822 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da12fcad-8df8-40ad-9f75-892a5c483245 None admin] RBAC: Authorizing `identity:get_user(user_id=079333c22795432e83a2d1a50caec117)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:42.445356 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da12fcad-8df8-40ad-9f75-892a5c483245 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:42.447361 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 90/189] 10.222.0.70 () {56 vars in 1177 bytes} [Fri Aug 19 15:52:42 2022] GET /identity/v3/users/079333c22795432e83a2d1a50caec117 => generated 289 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:42.449551 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da12fcad-8df8-40ad-9f75-892a5c483245 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:42.506047 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8e24e-f6e0-46bc-8c84-045f6016628c None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:42.539835 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:42.542674 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8fbb7-26c5-412e-8224-7ccfcd4fa2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:42.543303 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8fbb7-26c5-412e-8224-7ccfcd4fa2d7 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:42.543581 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8fbb7-26c5-412e-8224-7ccfcd4fa2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:42.543849 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8fbb7-26c5-412e-8224-7ccfcd4fa2d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:42.554998 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a8fbb7-26c5-412e-8224-7ccfcd4fa2d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:52:42.558085 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da12fcad-8df8-40ad-9f75-892a5c483245 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:42.560988 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-89a8fbb7-26c5-412e-8224-7ccfcd4fa2d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:52:42.560988 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:52:42.560988 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:52:42.560988 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:52:42.560988 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:52:42.560988 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:52:42.560988 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:52:42.560988 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:52:42.560988 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:52:42.560988 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:52:42.560988 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:52:42.560988 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:52:42.560988 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:52:42.560988 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:52:42.560988 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:52:42.560988 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:52:42.561860 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:52:42.561860 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:52:42.561860 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:52:42.561860 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:52:42.561860 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:52:42.561860 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:52:42.561860 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:52:42.561860 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:52:42.561860 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:52:42.561860 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:52:42.561860 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:52:42.561860 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:52:42.561860 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:52:42.561860 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:52:42.561860 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:52:42.561860 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:52:42.562643 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:52:42.562643 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:52:42.562643 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:52:42.562643 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:52:42.562643 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:52:42.562643 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:52:42.562643 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:52:42.562643 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:52:42.562643 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:52:42.562643 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:52:42.562643 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:52:42.562643 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:52:42.562643 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 100/190] 10.222.0.70 () {56 vars in 1096 bytes} [Fri Aug 19 15:52:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:52:42.562643 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8fbb7-26c5-412e-8224-7ccfcd4fa2d7 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:42.602195 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536fd17-0544-458c-b5df-dc71d5f1afd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:42.602815 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536fd17-0544-458c-b5df-dc71d5f1afd7 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:42.603740 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536fd17-0544-458c-b5df-dc71d5f1afd7 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:42.604255 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536fd17-0544-458c-b5df-dc71d5f1afd7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:42.620728 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5536fd17-0544-458c-b5df-dc71d5f1afd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:52:42.621338 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-5536fd17-0544-458c-b5df-dc71d5f1afd7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 15:52:42.621338 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:52:42.621338 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:52:42.621338 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:52:42.621338 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:52:42.621338 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:52:42.621338 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:52:42.621338 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:52:42.621338 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:52:42.621338 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:52:42.621338 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:52:42.621338 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:52:42.621338 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:52:42.621338 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:52:42.621338 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:52:42.621338 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:52:42.622322 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:52:42.622322 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:52:42.622322 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:52:42.622322 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:52:42.622322 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:52:42.622322 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:52:42.622322 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:52:42.622322 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:52:42.622322 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:52:42.622322 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:52:42.622322 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:52:42.622322 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:52:42.622322 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:52:42.622322 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:52:42.622322 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:52:42.622322 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:52:42.625425 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:52:42.625425 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:52:42.625425 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:52:42.625425 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:52:42.625425 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:52:42.625425 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:52:42.625425 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:52:42.625425 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:52:42.625425 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:52:42.625425 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:52:42.625425 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 15:52:42.625425 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:52:42.625425 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 91/191] 10.222.0.70 () {56 vars in 1114 bytes} [Fri Aug 19 15:52:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:52:42.625425 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536fd17-0544-458c-b5df-dc71d5f1afd7 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:42.658861 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:42.685370 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8fbb7-26c5-412e-8224-7ccfcd4fa2d7 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:42.723968 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd0cc99-fa27-42ad-aee9-eabaed17bfcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:42.724732 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0cc99-fa27-42ad-aee9-eabaed17bfcd None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:42.724888 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0cc99-fa27-42ad-aee9-eabaed17bfcd None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:42.725159 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0cc99-fa27-42ad-aee9-eabaed17bfcd None admin] PATH_INFO: `/v3/projects/963d02180caa42f79e40d9b4e2528065` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:42.726289 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd0cc99-fa27-42ad-aee9-eabaed17bfcd None admin] RBAC: Authorizing `identity:get_project(project_id=963d02180caa42f79e40d9b4e2528065)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:42.727730 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd0cc99-fa27-42ad-aee9-eabaed17bfcd None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:42.730410 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 101/192] 10.222.0.70 () {56 vars in 1186 bytes} [Fri Aug 19 15:52:42 2022] GET /identity/v3/projects/963d02180caa42f79e40d9b4e2528065 => generated 312 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:42.731173 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd0cc99-fa27-42ad-aee9-eabaed17bfcd None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:42.731931 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536fd17-0544-458c-b5df-dc71d5f1afd7 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:42.771064 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caffa8ec-c968-45ee-86de-53c833709c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:42.771657 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caffa8ec-c968-45ee-86de-53c833709c3a None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:42.771933 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caffa8ec-c968-45ee-86de-53c833709c3a None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:42.772203 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caffa8ec-c968-45ee-86de-53c833709c3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:42.787782 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:42.840102 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd0cc99-fa27-42ad-aee9-eabaed17bfcd None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:42.846682 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caffa8ec-c968-45ee-86de-53c833709c3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:42.848141 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caffa8ec-c968-45ee-86de-53c833709c3a None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:42.874742 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5499d5-749d-4a1c-a7ff-a13e8f7b38dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:42.875360 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5499d5-749d-4a1c-a7ff-a13e8f7b38dd None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:42.875635 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5499d5-749d-4a1c-a7ff-a13e8f7b38dd None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:42.875908 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5499d5-749d-4a1c-a7ff-a13e8f7b38dd None admin] PATH_INFO: `/v3/roles` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:42.876580 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5499d5-749d-4a1c-a7ff-a13e8f7b38dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:52:42.877187 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5499d5-749d-4a1c-a7ff-a13e8f7b38dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:42.878577 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5499d5-749d-4a1c-a7ff-a13e8f7b38dd None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:42.887054 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 102/193] 10.222.0.70 () {56 vars in 1099 bytes} [Fri Aug 19 15:52:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:42.887855 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5499d5-749d-4a1c-a7ff-a13e8f7b38dd None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:42.901907 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:42.958883 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 92/194] 10.222.0.70 () {58 vars in 1282 bytes} [Fri Aug 19 15:52:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:52:42.959763 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caffa8ec-c968-45ee-86de-53c833709c3a None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:43.002057 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5499d5-749d-4a1c-a7ff-a13e8f7b38dd None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:43.006826 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:43.038583 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60be292-f701-414e-a71d-0b4e0155151d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:43.039205 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60be292-f701-414e-a71d-0b4e0155151d None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:43.039481 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60be292-f701-414e-a71d-0b4e0155151d None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:43.039749 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60be292-f701-414e-a71d-0b4e0155151d None admin] PATH_INFO: `/v3/domains/default` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:43.040908 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60be292-f701-414e-a71d-0b4e0155151d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:43.042408 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60be292-f701-414e-a71d-0b4e0155151d None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:43.044165 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 103/195] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:52:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:43.044877 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60be292-f701-414e-a71d-0b4e0155151d None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:43.067304 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caffa8ec-c968-45ee-86de-53c833709c3a None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:43.104455 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe05218-1188-4e8e-b7e9-b23125a3c3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:43.105199 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe05218-1188-4e8e-b7e9-b23125a3c3f8 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:43.105478 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe05218-1188-4e8e-b7e9-b23125a3c3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:43.105749 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe05218-1188-4e8e-b7e9-b23125a3c3f8 None admin] PATH_INFO: `/v3/roles` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:43.106411 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe05218-1188-4e8e-b7e9-b23125a3c3f8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:52:43.106771 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe05218-1188-4e8e-b7e9-b23125a3c3f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:43.108176 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe05218-1188-4e8e-b7e9-b23125a3c3f8 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:43.116133 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 93/196] 10.222.0.70 () {56 vars in 1111 bytes} [Fri Aug 19 15:52:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:43.121653 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe05218-1188-4e8e-b7e9-b23125a3c3f8 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:43.128502 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:43.152851 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60be292-f701-414e-a71d-0b4e0155151d None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:43.186471 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece7494-965a-404d-880e-314bb4b396c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:43.187074 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece7494-965a-404d-880e-314bb4b396c0 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:43.187352 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece7494-965a-404d-880e-314bb4b396c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:43.187619 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece7494-965a-404d-880e-314bb4b396c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:43.188397 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece7494-965a-404d-880e-314bb4b396c0 None admin] RBAC: Adding query filter params (role.id=09971bc698e84205be000073fc048af2, scope.project.id=963d02180caa42f79e40d9b4e2528065, user.id=07c52c5ae7fc4412b1e1a11890bb9362) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:52:43.188732 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece7494-965a-404d-880e-314bb4b396c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:43.190217 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece7494-965a-404d-880e-314bb4b396c0 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:43.196139 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 104/197] 10.222.0.70 () {56 vars in 1374 bytes} [Fri Aug 19 15:52:43 2022] GET /identity/v3/role_assignments?user.id=07c52c5ae7fc4412b1e1a11890bb9362&scope.project.id=963d02180caa42f79e40d9b4e2528065&role.id=09971bc698e84205be000073fc048af2 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:43.197573 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece7494-965a-404d-880e-314bb4b396c0 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:43.244743 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe05218-1188-4e8e-b7e9-b23125a3c3f8 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:43.256142 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:43.287326 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab2918-3d2f-481c-bd32-d1b4ccb208c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:43.287975 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab2918-3d2f-481c-bd32-d1b4ccb208c5 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:43.288257 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab2918-3d2f-481c-bd32-d1b4ccb208c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:43.288529 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab2918-3d2f-481c-bd32-d1b4ccb208c5 None admin] PATH_INFO: `/v3/users/335fd9fd89384161802f3a27c0093815` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:43.304856 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dab2918-3d2f-481c-bd32-d1b4ccb208c5 None admin] RBAC: Authorizing `identity:get_user(user_id=335fd9fd89384161802f3a27c0093815)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:43.306416 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dab2918-3d2f-481c-bd32-d1b4ccb208c5 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:43.308314 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 94/198] 10.222.0.70 () {56 vars in 1177 bytes} [Fri Aug 19 15:52:43 2022] GET /identity/v3/users/335fd9fd89384161802f3a27c0093815 => generated 283 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:43.309061 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab2918-3d2f-481c-bd32-d1b4ccb208c5 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:43.339243 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece7494-965a-404d-880e-314bb4b396c0 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:43.385873 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eccca8-fe6f-4b35-9248-90e4c129de37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:43.386517 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eccca8-fe6f-4b35-9248-90e4c129de37 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:43.386792 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eccca8-fe6f-4b35-9248-90e4c129de37 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:43.387063 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eccca8-fe6f-4b35-9248-90e4c129de37 None admin] PATH_INFO: `/v3/projects/2e809a1a094b48538c004035badbc88e` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:43.388296 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eccca8-fe6f-4b35-9248-90e4c129de37 None admin] RBAC: Authorizing `identity:get_project(project_id=2e809a1a094b48538c004035badbc88e)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:43.389749 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eccca8-fe6f-4b35-9248-90e4c129de37 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:43.391569 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 105/199] 10.222.0.70 () {56 vars in 1186 bytes} [Fri Aug 19 15:52:43 2022] GET /identity/v3/projects/2e809a1a094b48538c004035badbc88e => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:43.392222 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eccca8-fe6f-4b35-9248-90e4c129de37 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:43.404968 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:43.443422 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab2918-3d2f-481c-bd32-d1b4ccb208c5 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:43.489553 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4b1e5e-5ed2-423e-929e-1fadbb492fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:43.490168 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b1e5e-5ed2-423e-929e-1fadbb492fe1 None admin] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:43.490442 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b1e5e-5ed2-423e-929e-1fadbb492fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:43.490708 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b1e5e-5ed2-423e-929e-1fadbb492fe1 None admin] PATH_INFO: `/v3/users` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:43.491354 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4b1e5e-5ed2-423e-929e-1fadbb492fe1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:43.492830 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4b1e5e-5ed2-423e-929e-1fadbb492fe1 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:43.515169 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eccca8-fe6f-4b35-9248-90e4c129de37 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:43.546093 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac343ca-047d-4b18-90d3-0d948088192b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:43.546755 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac343ca-047d-4b18-90d3-0d948088192b None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:43.547035 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac343ca-047d-4b18-90d3-0d948088192b None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:43.547302 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac343ca-047d-4b18-90d3-0d948088192b None admin] PATH_INFO: `/v3/users/335fd9fd89384161802f3a27c0093815` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:43.548409 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac343ca-047d-4b18-90d3-0d948088192b None admin] RBAC: Authorizing `identity:get_user(user_id=335fd9fd89384161802f3a27c0093815)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:43.549878 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac343ca-047d-4b18-90d3-0d948088192b None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:43.551449 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 106/200] 10.222.0.70 () {56 vars in 1177 bytes} [Fri Aug 19 15:52:43 2022] GET /identity/v3/users/335fd9fd89384161802f3a27c0093815 => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:43.552203 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac343ca-047d-4b18-90d3-0d948088192b None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:43.611005 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 95/201] 10.222.0.70 () {60 vars in 1132 bytes} [Fri Aug 19 15:52:43 2022] POST /identity/v3/users => generated 297 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:52:43.611968 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4b1e5e-5ed2-423e-929e-1fadbb492fe1 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:43.637710 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:43.639998 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:43.673692 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac343ca-047d-4b18-90d3-0d948088192b None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:43.715360 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c3fbe-615c-42cd-8e2b-f9691ffc800e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:43.715982 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c3fbe-615c-42cd-8e2b-f9691ffc800e None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:43.716257 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c3fbe-615c-42cd-8e2b-f9691ffc800e None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:43.716525 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c3fbe-615c-42cd-8e2b-f9691ffc800e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:43.736382 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4b1e5e-5ed2-423e-929e-1fadbb492fe1 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:43.778900 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb72a7ca-9b12-4b74-8fc6-f2ee01c930a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:43.779425 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72a7ca-9b12-4b74-8fc6-f2ee01c930a1 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:43.779706 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72a7ca-9b12-4b74-8fc6-f2ee01c930a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:43.779962 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72a7ca-9b12-4b74-8fc6-f2ee01c930a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:43.780882 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb72a7ca-9b12-4b74-8fc6-f2ee01c930a1 None admin] RBAC: Adding query filter params (role.id=2e3dded4c3734675b1978c6f9ec33c7b, scope.project.id=2e809a1a094b48538c004035badbc88e, user.id=079333c22795432e83a2d1a50caec117) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:52:43.781191 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb72a7ca-9b12-4b74-8fc6-f2ee01c930a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:43.782665 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb72a7ca-9b12-4b74-8fc6-f2ee01c930a1 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:43.792097 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 96/202] 10.222.0.70 () {56 vars in 1374 bytes} [Fri Aug 19 15:52:43 2022] GET /identity/v3/role_assignments?user.id=079333c22795432e83a2d1a50caec117&scope.project.id=2e809a1a094b48538c004035badbc88e&role.id=2e3dded4c3734675b1978c6f9ec33c7b => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:43.793327 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb72a7ca-9b12-4b74-8fc6-f2ee01c930a1 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:43.811906 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9c3fbe-615c-42cd-8e2b-f9691ffc800e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:43.814026 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9c3fbe-615c-42cd-8e2b-f9691ffc800e None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:43.918559 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:43.926976 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:43.937990 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb72a7ca-9b12-4b74-8fc6-f2ee01c930a1 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:43.959951 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 107/203] 10.222.0.70 () {58 vars in 1282 bytes} [Fri Aug 19 15:52:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:52:43.968293 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c3fbe-615c-42cd-8e2b-f9691ffc800e None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:43.996470 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e1105-c395-4b89-b408-5be8ee3af95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:43.997154 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e1105-c395-4b89-b408-5be8ee3af95f None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:43.997432 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e1105-c395-4b89-b408-5be8ee3af95f None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:43.997770 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e1105-c395-4b89-b408-5be8ee3af95f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:44.107336 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e1105-c395-4b89-b408-5be8ee3af95f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:44.108856 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e1105-c395-4b89-b408-5be8ee3af95f None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:44.127577 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c3fbe-615c-42cd-8e2b-f9691ffc800e None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:44.165595 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f4721-937e-4712-9d9a-12c194eabe2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:44.166767 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f4721-937e-4712-9d9a-12c194eabe2b None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:44.167092 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f4721-937e-4712-9d9a-12c194eabe2b None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:44.167360 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f4721-937e-4712-9d9a-12c194eabe2b None admin] PATH_INFO: `/v3/projects/8299174a2d574620a12d3d2e42f01c55` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:44.168588 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51f4721-937e-4712-9d9a-12c194eabe2b None admin] RBAC: Authorizing `identity:get_project(project_id=8299174a2d574620a12d3d2e42f01c55)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:44.170590 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51f4721-937e-4712-9d9a-12c194eabe2b None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:44.172562 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 108/204] 10.222.0.70 () {56 vars in 1186 bytes} [Fri Aug 19 15:52:43 2022] GET /identity/v3/projects/8299174a2d574620a12d3d2e42f01c55 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:44.178194 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f4721-937e-4712-9d9a-12c194eabe2b None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:44.229460 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:44.230021 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:44.242431 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 97/205] 10.222.0.70 () {58 vars in 1282 bytes} [Fri Aug 19 15:52:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:52:44.249439 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e1105-c395-4b89-b408-5be8ee3af95f None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:44.314710 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f4721-937e-4712-9d9a-12c194eabe2b None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:44.359510 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e1105-c395-4b89-b408-5be8ee3af95f None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:44.363682 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ace143f-155f-4a43-9f2d-af4817540f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:44.364517 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace143f-155f-4a43-9f2d-af4817540f15 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:44.364757 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace143f-155f-4a43-9f2d-af4817540f15 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:44.365029 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace143f-155f-4a43-9f2d-af4817540f15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:44.365879 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ace143f-155f-4a43-9f2d-af4817540f15 None admin] RBAC: Adding query filter params (role.id=2f6cb7d6ec874879972a12a63d61068d, scope.project.id=8299174a2d574620a12d3d2e42f01c55, user.id=335fd9fd89384161802f3a27c0093815) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:52:44.366190 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ace143f-155f-4a43-9f2d-af4817540f15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:44.368220 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ace143f-155f-4a43-9f2d-af4817540f15 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:44.377887 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 109/206] 10.222.0.70 () {56 vars in 1374 bytes} [Fri Aug 19 15:52:44 2022] GET /identity/v3/role_assignments?user.id=335fd9fd89384161802f3a27c0093815&scope.project.id=8299174a2d574620a12d3d2e42f01c55&role.id=2f6cb7d6ec874879972a12a63d61068d => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:44.406144 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec3f52-152e-4f23-9532-00e0642e8c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:44.407184 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec3f52-152e-4f23-9532-00e0642e8c44 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:44.407684 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec3f52-152e-4f23-9532-00e0642e8c44 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:44.408149 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec3f52-152e-4f23-9532-00e0642e8c44 None admin] PATH_INFO: `/v3/projects/8299174a2d574620a12d3d2e42f01c55` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:44.409838 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec3f52-152e-4f23-9532-00e0642e8c44 None admin] RBAC: Authorizing `identity:get_project(project_id=8299174a2d574620a12d3d2e42f01c55)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:44.411576 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec3f52-152e-4f23-9532-00e0642e8c44 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:44.413997 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 98/207] 10.222.0.70 () {56 vars in 1186 bytes} [Fri Aug 19 15:52:44 2022] GET /identity/v3/projects/8299174a2d574620a12d3d2e42f01c55 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:44.419851 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ace143f-155f-4a43-9f2d-af4817540f15 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:44.540229 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ace143f-155f-4a43-9f2d-af4817540f15 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:44.551799 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:44.581671 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeedc9c-7829-4c09-b7f6-6db966d91fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:44.582289 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeedc9c-7829-4c09-b7f6-6db966d91fe6 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:44.582568 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeedc9c-7829-4c09-b7f6-6db966d91fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:44.582841 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeedc9c-7829-4c09-b7f6-6db966d91fe6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:44.583794 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeedc9c-7829-4c09-b7f6-6db966d91fe6 None admin] RBAC: Adding query filter params (role.id=294bcd6132ef46d48aff3efa4d77fa0a, scope.project.id=8299174a2d574620a12d3d2e42f01c55, user.id=335fd9fd89384161802f3a27c0093815) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:52:44.583895 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeedc9c-7829-4c09-b7f6-6db966d91fe6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:44.585349 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeedc9c-7829-4c09-b7f6-6db966d91fe6 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:44.592855 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 110/208] 10.222.0.70 () {56 vars in 1374 bytes} [Fri Aug 19 15:52:44 2022] GET /identity/v3/role_assignments?user.id=335fd9fd89384161802f3a27c0093815&scope.project.id=8299174a2d574620a12d3d2e42f01c55&role.id=294bcd6132ef46d48aff3efa4d77fa0a => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:52:46.152846 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46b4ae-974a-474f-83d2-996deedebc18 None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:46.153421 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46b4ae-974a-474f-83d2-996deedebc18 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:46.153421 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46b4ae-974a-474f-83d2-996deedebc18 None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:46.154719 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 99/209] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:52:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 15:52:46.160133 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596fd64-cfe9-4002-bb46-75df9b03ab0e None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:46.160567 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596fd64-cfe9-4002-bb46-75df9b03ab0e None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:46.160892 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596fd64-cfe9-4002-bb46-75df9b03ab0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:46.180032 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-2596fd64-cfe9-4002-bb46-75df9b03ab0e None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:52:46.181307 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-2596fd64-cfe9-4002-bb46-75df9b03ab0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:52:46.212339 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2359b-2508-4316-8fca-b17ba52b0059 None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:46.213137 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2359b-2508-4316-8fca-b17ba52b0059 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:46.214121 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2359b-2508-4316-8fca-b17ba52b0059 None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:46.215651 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 100/210] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:52:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:52:46.221689 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc4afc-8893-4ff6-aa2b-7e483b14cbd0 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:46.222253 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc4afc-8893-4ff6-aa2b-7e483b14cbd0 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:46.222727 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc4afc-8893-4ff6-aa2b-7e483b14cbd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:46.245255 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-d4dc4afc-8893-4ff6-aa2b-7e483b14cbd0 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:52:46.247078 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-d4dc4afc-8893-4ff6-aa2b-7e483b14cbd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:52:46.264398 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 111/211] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:52:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:52:46.308824 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:46.330181 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 101/212] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:52:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 15:52:46.622670 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2596fd64-cfe9-4002-bb46-75df9b03ab0e None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:46.686701 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc4afc-8893-4ff6-aa2b-7e483b14cbd0 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:46.756356 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2596fd64-cfe9-4002-bb46-75df9b03ab0e None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:46.758200 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:46.806333 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b671cfec-3574-4c2f-9127-d60359b15f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:46.808239 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b671cfec-3574-4c2f-9127-d60359b15f8e None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:46.808773 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b671cfec-3574-4c2f-9127-d60359b15f8e None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:46.809247 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b671cfec-3574-4c2f-9127-d60359b15f8e None admin] PATH_INFO: `/v3/roles/member` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:46.826981 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b671cfec-3574-4c2f-9127-d60359b15f8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:52:46.827338 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc4afc-8893-4ff6-aa2b-7e483b14cbd0 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:46.833554 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-b671cfec-3574-4c2f-9127-d60359b15f8e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:52:46.833554 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:52:46.833554 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:52:46.833554 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:52:46.833554 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:52:46.833554 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:52:46.833554 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:52:46.833554 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:52:46.833554 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:52:46.833554 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:52:46.833554 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:52:46.833554 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:52:46.833554 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:52:46.833554 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:52:46.833554 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:52:46.833554 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:52:46.834638 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:52:46.834638 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:52:46.834638 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:52:46.834638 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:52:46.834638 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:52:46.834638 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:52:46.834638 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:52:46.834638 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:52:46.834638 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:52:46.834638 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:52:46.834638 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:52:46.834638 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:52:46.834638 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:52:46.834638 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:52:46.834638 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:52:46.834638 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:52:46.835406 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:52:46.835406 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:52:46.835406 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:52:46.835406 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:52:46.835406 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:52:46.835406 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:52:46.835406 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:52:46.835406 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:52:46.835406 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:52:46.835406 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:52:46.835406 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:52:46.835406 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:52:46.838848 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 112/213] 10.222.0.70 () {56 vars in 1099 bytes} [Fri Aug 19 15:52:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:52:46.845295 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b671cfec-3574-4c2f-9127-d60359b15f8e None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:46.874758 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5201b6-3a26-44b3-8c14-9a3685d293f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:46.875310 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5201b6-3a26-44b3-8c14-9a3685d293f5 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:46.875600 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5201b6-3a26-44b3-8c14-9a3685d293f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:46.875902 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5201b6-3a26-44b3-8c14-9a3685d293f5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:46.877418 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5201b6-3a26-44b3-8c14-9a3685d293f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:46.878956 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5201b6-3a26-44b3-8c14-9a3685d293f5 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:46.880733 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 102/214] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:52:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:52:46.881752 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542f0b8-0302-4a5f-9365-bd51e5f3751d None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:46.882030 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542f0b8-0302-4a5f-9365-bd51e5f3751d None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:46.882298 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542f0b8-0302-4a5f-9365-bd51e5f3751d None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:46.883725 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 103/215] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:52:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:52:46.888378 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6542f0b8-0302-4a5f-9365-bd51e5f3751d None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:46.948525 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:46.969974 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b671cfec-3574-4c2f-9127-d60359b15f8e None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:47.002372 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6542f0b8-0302-4a5f-9365-bd51e5f3751d None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:47.004720 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b7504d-c356-45dd-b8a7-6e7d45064833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:47.005330 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7504d-c356-45dd-b8a7-6e7d45064833 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:47.005602 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7504d-c356-45dd-b8a7-6e7d45064833 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:47.005863 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7504d-c356-45dd-b8a7-6e7d45064833 None admin] PATH_INFO: `/v3/roles` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:47.006515 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b7504d-c356-45dd-b8a7-6e7d45064833 None admin] RBAC: Adding query filter params (name=member) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:52:47.006809 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b7504d-c356-45dd-b8a7-6e7d45064833 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:47.008192 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b7504d-c356-45dd-b8a7-6e7d45064833 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:47.017483 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 113/216] 10.222.0.70 () {56 vars in 1101 bytes} [Fri Aug 19 15:52:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:52:47.018800 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf72ce9-c0d9-409d-9c5e-84a42d42a144 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:47.019084 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf72ce9-c0d9-409d-9c5e-84a42d42a144 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:47.019369 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf72ce9-c0d9-409d-9c5e-84a42d42a144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:47.038168 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-bcf72ce9-c0d9-409d-9c5e-84a42d42a144 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:52:47.038620 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f4b9b-29d3-4647-a200-ad4dd7dc0c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:47.039236 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f4b9b-29d3-4647-a200-ad4dd7dc0c47 None admin] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:47.039371 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-bcf72ce9-c0d9-409d-9c5e-84a42d42a144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:52:47.039517 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f4b9b-29d3-4647-a200-ad4dd7dc0c47 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:47.039786 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f4b9b-29d3-4647-a200-ad4dd7dc0c47 None admin] PATH_INFO: `/v3/users` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:47.041057 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160f4b9b-29d3-4647-a200-ad4dd7dc0c47 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:47.042827 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160f4b9b-29d3-4647-a200-ad4dd7dc0c47 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:47.059596 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:47.110565 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 114/217] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:52:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:52:47.111850 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec3158-4a8d-4d6c-b725-f12424aadf7b None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:47.112133 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec3158-4a8d-4d6c-b725-f12424aadf7b None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:47.112400 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec3158-4a8d-4d6c-b725-f12424aadf7b None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:47.113813 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 115/218] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:52:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:52:47.118213 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fec3158-4a8d-4d6c-b725-f12424aadf7b None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:47.132043 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 104/219] 10.222.0.70 () {60 vars in 1132 bytes} [Fri Aug 19 15:52:46 2022] POST /identity/v3/users => generated 297 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:52:47.133625 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c5f82-71b3-4f06-942a-a8bcbb6ffca0 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:47.134065 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c5f82-71b3-4f06-942a-a8bcbb6ffca0 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:47.134362 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c5f82-71b3-4f06-942a-a8bcbb6ffca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:47.171860 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-9c9c5f82-71b3-4f06-942a-a8bcbb6ffca0 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:52:47.173512 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-9c9c5f82-71b3-4f06-942a-a8bcbb6ffca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:52:47.266973 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fec3158-4a8d-4d6c-b725-f12424aadf7b None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:47.268604 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 105/220] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:52:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:52:47.309789 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db30652a-bdcc-42d6-8299-8103a4a5e663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:47.310900 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db30652a-bdcc-42d6-8299-8103a4a5e663 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:47.311382 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db30652a-bdcc-42d6-8299-8103a4a5e663 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:47.311854 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db30652a-bdcc-42d6-8299-8103a4a5e663 None admin] PATH_INFO: `/v3/users/d3afec39678b42589a04480695778df2` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:47.328386 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db30652a-bdcc-42d6-8299-8103a4a5e663 None admin] RBAC: Authorizing `identity:get_user(user_id=d3afec39678b42589a04480695778df2)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:47.330217 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db30652a-bdcc-42d6-8299-8103a4a5e663 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:47.332191 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 116/221] 10.222.0.70 () {56 vars in 1177 bytes} [Fri Aug 19 15:52:47 2022] GET /identity/v3/users/d3afec39678b42589a04480695778df2 => generated 297 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:47.339823 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c5f82-71b3-4f06-942a-a8bcbb6ffca0 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:47.395064 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:47.460818 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db30652a-bdcc-42d6-8299-8103a4a5e663 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:47.482756 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:47.499558 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c5f82-71b3-4f06-942a-a8bcbb6ffca0 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:47.548437 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e424fac-bc08-45a4-b52e-cbb32fcba0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:47.549624 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e424fac-bc08-45a4-b52e-cbb32fcba0b2 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:47.549905 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e424fac-bc08-45a4-b52e-cbb32fcba0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:47.550179 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e424fac-bc08-45a4-b52e-cbb32fcba0b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:47.630686 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db30652a-bdcc-42d6-8299-8103a4a5e663 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:47.643333 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e424fac-bc08-45a4-b52e-cbb32fcba0b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:47.645753 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e424fac-bc08-45a4-b52e-cbb32fcba0b2 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:47.696135 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:47.700336 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9689def-7649-4b0f-baac-1335ddf00503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:47.701333 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9689def-7649-4b0f-baac-1335ddf00503 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:47.701819 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9689def-7649-4b0f-baac-1335ddf00503 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:47.702280 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9689def-7649-4b0f-baac-1335ddf00503 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:47.720254 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9689def-7649-4b0f-baac-1335ddf00503 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:52:47.725900 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-a9689def-7649-4b0f-baac-1335ddf00503 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:52:47.725900 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:52:47.725900 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:52:47.725900 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:52:47.725900 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:52:47.725900 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:52:47.725900 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:52:47.725900 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:52:47.725900 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:52:47.725900 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:52:47.725900 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:52:47.725900 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:52:47.725900 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:52:47.725900 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:52:47.725900 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:52:47.725900 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:52:47.726828 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:52:47.726828 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:52:47.726828 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:52:47.726828 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:52:47.726828 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:52:47.726828 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:52:47.726828 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:52:47.726828 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:52:47.726828 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:52:47.726828 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:52:47.726828 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:52:47.726828 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:52:47.726828 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:52:47.726828 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:52:47.726828 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:52:47.726828 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:52:47.727627 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:52:47.727627 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:52:47.727627 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:52:47.727627 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:52:47.727627 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:52:47.727627 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:52:47.727627 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:52:47.727627 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:52:47.727627 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:52:47.727627 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:52:47.727627 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:52:47.727627 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:52:47.727627 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 117/222] 10.222.0.70 () {56 vars in 1096 bytes} [Fri Aug 19 15:52:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:52:47.729015 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9689def-7649-4b0f-baac-1335ddf00503 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:47.813034 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 106/223] 10.222.0.70 () {58 vars in 1282 bytes} [Fri Aug 19 15:52:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 15:52:47.814279 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e424fac-bc08-45a4-b52e-cbb32fcba0b2 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:47.830994 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:47.865510 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9689def-7649-4b0f-baac-1335ddf00503 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:47.907420 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca590ba-a422-4010-9955-45d5d4d87e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:47.908104 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca590ba-a422-4010-9955-45d5d4d87e33 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:47.908442 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca590ba-a422-4010-9955-45d5d4d87e33 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:47.908748 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca590ba-a422-4010-9955-45d5d4d87e33 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:47.923320 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca590ba-a422-4010-9955-45d5d4d87e33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:52:47.930453 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-4ca590ba-a422-4010-9955-45d5d4d87e33 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 15:52:47.930453 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:52:47.930453 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:52:47.930453 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:52:47.930453 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:52:47.930453 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:52:47.930453 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:52:47.930453 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:52:47.930453 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:52:47.930453 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:52:47.930453 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:52:47.930453 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:52:47.930453 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:52:47.930453 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:52:47.930453 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:52:47.930453 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:52:47.931925 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:52:47.931925 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:52:47.931925 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:52:47.931925 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:52:47.931925 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:52:47.931925 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:52:47.931925 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:52:47.931925 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:52:47.931925 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:52:47.931925 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:52:47.931925 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:52:47.931925 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:52:47.931925 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:52:47.931925 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:52:47.931925 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:52:47.931925 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:52:47.932726 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:52:47.932726 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:52:47.932726 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:52:47.932726 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:52:47.932726 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:52:47.932726 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:52:47.932726 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:52:47.932726 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:52:47.932726 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:52:47.932726 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:52:47.932726 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 15:52:47.932726 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:52:47.933328 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 118/224] 10.222.0.70 () {56 vars in 1114 bytes} [Fri Aug 19 15:52:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:52:47.939222 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca590ba-a422-4010-9955-45d5d4d87e33 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:47.945986 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e424fac-bc08-45a4-b52e-cbb32fcba0b2 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:47.985310 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d39518-695e-448e-8624-14c838634ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:47.986286 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d39518-695e-448e-8624-14c838634ef4 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:47.986756 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d39518-695e-448e-8624-14c838634ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:47.987239 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d39518-695e-448e-8624-14c838634ef4 None admin] PATH_INFO: `/v3/roles` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:47.988113 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d39518-695e-448e-8624-14c838634ef4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:52:47.988631 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d39518-695e-448e-8624-14c838634ef4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:47.990432 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d39518-695e-448e-8624-14c838634ef4 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:48.001606 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 107/225] 10.222.0.70 () {56 vars in 1099 bytes} [Fri Aug 19 15:52:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:48.003099 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d39518-695e-448e-8624-14c838634ef4 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:48.033057 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:48.061503 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca590ba-a422-4010-9955-45d5d4d87e33 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:48.099056 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f7f81b-92b6-4da4-9252-4084b6ac424b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:48.099698 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7f81b-92b6-4da4-9252-4084b6ac424b None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:48.099967 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7f81b-92b6-4da4-9252-4084b6ac424b None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:48.100235 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7f81b-92b6-4da4-9252-4084b6ac424b None admin] PATH_INFO: `/v3/projects/8299174a2d574620a12d3d2e42f01c55` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:48.101243 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:48.102915 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f7f81b-92b6-4da4-9252-4084b6ac424b None admin] RBAC: Authorizing `identity:get_project(project_id=8299174a2d574620a12d3d2e42f01c55)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:48.105443 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f7f81b-92b6-4da4-9252-4084b6ac424b None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:48.112186 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 119/226] 10.222.0.70 () {56 vars in 1186 bytes} [Fri Aug 19 15:52:47 2022] GET /identity/v3/projects/8299174a2d574620a12d3d2e42f01c55 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:48.115083 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f7f81b-92b6-4da4-9252-4084b6ac424b None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:48.116931 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d39518-695e-448e-8624-14c838634ef4 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:48.160255 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8417d05-9376-433d-80a4-39268b50b22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:48.161317 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8417d05-9376-433d-80a4-39268b50b22d None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:48.161812 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8417d05-9376-433d-80a4-39268b50b22d None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:48.162296 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8417d05-9376-433d-80a4-39268b50b22d None admin] PATH_INFO: `/v3/roles` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:48.163189 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8417d05-9376-433d-80a4-39268b50b22d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:52:48.163681 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8417d05-9376-433d-80a4-39268b50b22d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:48.165435 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8417d05-9376-433d-80a4-39268b50b22d None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:48.175868 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 108/227] 10.222.0.70 () {56 vars in 1111 bytes} [Fri Aug 19 15:52:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:48.181929 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8417d05-9376-433d-80a4-39268b50b22d None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:48.230334 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f7f81b-92b6-4da4-9252-4084b6ac424b None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:48.249718 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:48.268036 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee18bc6f-2ed4-4901-a190-9e04ce928311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:48.268729 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18bc6f-2ed4-4901-a190-9e04ce928311 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:48.268980 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18bc6f-2ed4-4901-a190-9e04ce928311 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:48.269251 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18bc6f-2ed4-4901-a190-9e04ce928311 None admin] PATH_INFO: `/v3/users/335fd9fd89384161802f3a27c0093815` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:48.270548 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee18bc6f-2ed4-4901-a190-9e04ce928311 None admin] RBAC: Authorizing `identity:get_user(user_id=335fd9fd89384161802f3a27c0093815)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:48.272089 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee18bc6f-2ed4-4901-a190-9e04ce928311 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:48.273595 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 120/228] 10.222.0.70 () {56 vars in 1177 bytes} [Fri Aug 19 15:52:48 2022] GET /identity/v3/users/335fd9fd89384161802f3a27c0093815 => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:48.274443 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee18bc6f-2ed4-4901-a190-9e04ce928311 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:48.293419 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8417d05-9376-433d-80a4-39268b50b22d None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:48.330784 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a38b8-544f-4823-b1b2-7b40e48c81d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:48.331788 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a38b8-544f-4823-b1b2-7b40e48c81d4 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:48.332324 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a38b8-544f-4823-b1b2-7b40e48c81d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:48.332899 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a38b8-544f-4823-b1b2-7b40e48c81d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:48.334010 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15a38b8-544f-4823-b1b2-7b40e48c81d4 None admin] RBAC: Adding query filter params (role.id=09971bc698e84205be000073fc048af2, scope.project.id=8299174a2d574620a12d3d2e42f01c55, user.id=d3afec39678b42589a04480695778df2) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:52:48.334588 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15a38b8-544f-4823-b1b2-7b40e48c81d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:48.336277 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15a38b8-544f-4823-b1b2-7b40e48c81d4 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:48.343397 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 109/229] 10.222.0.70 () {56 vars in 1374 bytes} [Fri Aug 19 15:52:48 2022] GET /identity/v3/role_assignments?user.id=d3afec39678b42589a04480695778df2&scope.project.id=8299174a2d574620a12d3d2e42f01c55&role.id=09971bc698e84205be000073fc048af2 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:48.344566 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a38b8-544f-4823-b1b2-7b40e48c81d4 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:48.389045 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:48.425425 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee18bc6f-2ed4-4901-a190-9e04ce928311 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:48.467504 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ea765-4376-45e8-9230-c50d69a410fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:48.468141 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ea765-4376-45e8-9230-c50d69a410fb None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:48.468413 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ea765-4376-45e8-9230-c50d69a410fb None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:48.468806 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ea765-4376-45e8-9230-c50d69a410fb None admin] PATH_INFO: `/v3/users/335fd9fd89384161802f3a27c0093815` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:48.469923 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5ea765-4376-45e8-9230-c50d69a410fb None admin] RBAC: Authorizing `identity:get_user(user_id=335fd9fd89384161802f3a27c0093815)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:48.471610 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5ea765-4376-45e8-9230-c50d69a410fb None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:48.478085 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 121/230] 10.222.0.70 () {56 vars in 1177 bytes} [Fri Aug 19 15:52:48 2022] GET /identity/v3/users/335fd9fd89384161802f3a27c0093815 => generated 283 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:48.479845 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ea765-4376-45e8-9230-c50d69a410fb None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:48.519237 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a38b8-544f-4823-b1b2-7b40e48c81d4 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:48.566080 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:48.572451 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f8c29-71bd-4904-b0f8-0ebf5691b4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:48.573293 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f8c29-71bd-4904-b0f8-0ebf5691b4e4 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:48.573578 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f8c29-71bd-4904-b0f8-0ebf5691b4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:48.573849 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f8c29-71bd-4904-b0f8-0ebf5691b4e4 None admin] PATH_INFO: `/v3/projects/8299174a2d574620a12d3d2e42f01c55` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:48.580259 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f8c29-71bd-4904-b0f8-0ebf5691b4e4 None admin] RBAC: Authorizing `identity:get_project(project_id=8299174a2d574620a12d3d2e42f01c55)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:48.583451 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f8c29-71bd-4904-b0f8-0ebf5691b4e4 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:48.586631 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 110/231] 10.222.0.70 () {56 vars in 1186 bytes} [Fri Aug 19 15:52:48 2022] GET /identity/v3/projects/8299174a2d574620a12d3d2e42f01c55 => generated 302 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:48.593931 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f8c29-71bd-4904-b0f8-0ebf5691b4e4 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:48.614727 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ea765-4376-45e8-9230-c50d69a410fb None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:48.696130 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbdff2c-57c2-4ac7-b4d6-d7e061edad70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:48.696130 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdff2c-57c2-4ac7-b4d6-d7e061edad70 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:48.696130 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdff2c-57c2-4ac7-b4d6-d7e061edad70 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:48.696130 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdff2c-57c2-4ac7-b4d6-d7e061edad70 None admin] PATH_INFO: `/v3/projects/8299174a2d574620a12d3d2e42f01c55` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:48.696517 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbdff2c-57c2-4ac7-b4d6-d7e061edad70 None admin] RBAC: Authorizing `identity:get_project(project_id=8299174a2d574620a12d3d2e42f01c55)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:48.698590 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbdff2c-57c2-4ac7-b4d6-d7e061edad70 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:48.703515 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 122/232] 10.222.0.70 () {56 vars in 1186 bytes} [Fri Aug 19 15:52:48 2022] GET /identity/v3/projects/8299174a2d574620a12d3d2e42f01c55 => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:52:48.709359 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbdff2c-57c2-4ac7-b4d6-d7e061edad70 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:48.715203 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:48.748060 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f8c29-71bd-4904-b0f8-0ebf5691b4e4 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:48.795256 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b880ac87-5fd6-484a-888d-c9a4dba998d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:48.795933 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880ac87-5fd6-484a-888d-c9a4dba998d3 None admin] REQUEST_METHOD: `PUT` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:48.796214 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880ac87-5fd6-484a-888d-c9a4dba998d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:48.796490 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880ac87-5fd6-484a-888d-c9a4dba998d3 None admin] PATH_INFO: `/v3/projects/8299174a2d574620a12d3d2e42f01c55/users/335fd9fd89384161802f3a27c0093815/roles/2f6cb7d6ec874879972a12a63d61068d` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:48.803953 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b880ac87-5fd6-484a-888d-c9a4dba998d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=8299174a2d574620a12d3d2e42f01c55, user_id=335fd9fd89384161802f3a27c0093815, role_id=2f6cb7d6ec874879972a12a63d61068d)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:48.805448 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b880ac87-5fd6-484a-888d-c9a4dba998d3 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:48.880282 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbdff2c-57c2-4ac7-b4d6-d7e061edad70 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:48.914443 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 111/233] 10.222.0.70 () {58 vars in 1439 bytes} [Fri Aug 19 15:52:48 2022] PUT /identity/v3/projects/8299174a2d574620a12d3d2e42f01c55/users/335fd9fd89384161802f3a27c0093815/roles/2f6cb7d6ec874879972a12a63d61068d => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:52:48.942551 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88cb4a-c92b-400e-a7d2-221081eb7082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:48.943235 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88cb4a-c92b-400e-a7d2-221081eb7082 None admin] REQUEST_METHOD: `PUT` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:48.943512 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88cb4a-c92b-400e-a7d2-221081eb7082 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:48.943784 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88cb4a-c92b-400e-a7d2-221081eb7082 None admin] PATH_INFO: `/v3/projects/8299174a2d574620a12d3d2e42f01c55/users/335fd9fd89384161802f3a27c0093815/roles/294bcd6132ef46d48aff3efa4d77fa0a` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:48.946105 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab88cb4a-c92b-400e-a7d2-221081eb7082 None admin] RBAC: Authorizing `identity:create_grant(project_id=8299174a2d574620a12d3d2e42f01c55, user_id=335fd9fd89384161802f3a27c0093815, role_id=294bcd6132ef46d48aff3efa4d77fa0a)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:48.947792 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab88cb4a-c92b-400e-a7d2-221081eb7082 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:49.097701 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 123/234] 10.222.0.70 () {58 vars in 1439 bytes} [Fri Aug 19 15:52:48 2022] PUT /identity/v3/projects/8299174a2d574620a12d3d2e42f01c55/users/335fd9fd89384161802f3a27c0093815/roles/294bcd6132ef46d48aff3efa4d77fa0a => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:52:50.016308 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80de62d-f370-4834-bad0-369a395483c9 None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:50.016881 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80de62d-f370-4834-bad0-369a395483c9 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:50.016881 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80de62d-f370-4834-bad0-369a395483c9 None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:50.018214 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 112/235] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:52:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:52:50.023505 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436797f3-847b-496f-b84e-93678c4e032d None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:50.024029 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436797f3-847b-496f-b84e-93678c4e032d None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:50.024029 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436797f3-847b-496f-b84e-93678c4e032d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:50.047433 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-436797f3-847b-496f-b84e-93678c4e032d None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:52:50.048637 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-436797f3-847b-496f-b84e-93678c4e032d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:52:50.093223 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736d08a-5b98-41d6-9242-8e45c2125422 None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:50.093834 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736d08a-5b98-41d6-9242-8e45c2125422 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:50.094331 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736d08a-5b98-41d6-9242-8e45c2125422 None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:50.095864 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 113/236] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:52:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 15:52:50.101376 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831bdb88-bd4c-4a42-a9ae-e8de8d359423 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:50.101947 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831bdb88-bd4c-4a42-a9ae-e8de8d359423 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:50.102442 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831bdb88-bd4c-4a42-a9ae-e8de8d359423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:50.130752 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:50.137692 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-831bdb88-bd4c-4a42-a9ae-e8de8d359423 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:52:50.139151 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-831bdb88-bd4c-4a42-a9ae-e8de8d359423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:52:50.141224 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 124/237] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:52:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:52:50.210271 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:50.246649 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 114/238] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:52:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 15:52:50.601183 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436797f3-847b-496f-b84e-93678c4e032d None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:50.754430 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436797f3-847b-496f-b84e-93678c4e032d None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:50.795769 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea6dabd-a60a-4436-a5ba-7407d93c89b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:50.796573 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6dabd-a60a-4436-a5ba-7407d93c89b7 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:50.796983 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6dabd-a60a-4436-a5ba-7407d93c89b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:50.797339 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6dabd-a60a-4436-a5ba-7407d93c89b7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:50.814064 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea6dabd-a60a-4436-a5ba-7407d93c89b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:52:50.818856 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-aea6dabd-a60a-4436-a5ba-7407d93c89b7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 15:52:50.818856 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:52:50.818856 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:52:50.818856 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:52:50.818856 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:52:50.818856 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:52:50.818856 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:52:50.818856 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:52:50.818856 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:52:50.818856 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:52:50.818856 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:52:50.818856 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:52:50.818856 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:52:50.818856 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:52:50.818856 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:52:50.818856 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:52:50.819721 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:52:50.819721 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:52:50.819721 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:52:50.819721 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:52:50.819721 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:52:50.819721 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:52:50.819721 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:52:50.819721 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:52:50.819721 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:52:50.819721 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:52:50.819721 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:52:50.819721 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:52:50.819721 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:52:50.819721 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:52:50.819721 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:52:50.819721 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:52:50.820483 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:52:50.820483 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:52:50.820483 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:52:50.820483 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:52:50.820483 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:52:50.820483 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:52:50.820483 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:52:50.820483 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:52:50.820483 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:52:50.820483 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:52:50.820483 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 15:52:50.820483 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:52:50.820483 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 125/239] 10.222.0.70 () {56 vars in 1099 bytes} [Fri Aug 19 15:52:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:52:50.826486 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831bdb88-bd4c-4a42-a9ae-e8de8d359423 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:50.830129 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea6dabd-a60a-4436-a5ba-7407d93c89b7 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:50.896623 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:50.981649 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea6dabd-a60a-4436-a5ba-7407d93c89b7 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:51.024628 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa075c-d988-41f4-b4bf-cb7381bf592d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:51.025341 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa075c-d988-41f4-b4bf-cb7381bf592d None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:51.025555 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa075c-d988-41f4-b4bf-cb7381bf592d None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:51.025789 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa075c-d988-41f4-b4bf-cb7381bf592d None admin] PATH_INFO: `/v3/domains/default` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:51.027058 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fa075c-d988-41f4-b4bf-cb7381bf592d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:51.028698 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fa075c-d988-41f4-b4bf-cb7381bf592d None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:51.031809 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 126/240] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:52:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:52:51.041966 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa075c-d988-41f4-b4bf-cb7381bf592d None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:51.094706 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831bdb88-bd4c-4a42-a9ae-e8de8d359423 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:51.165120 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1645849e-954e-4822-8874-78766fad5c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:51.166397 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645849e-954e-4822-8874-78766fad5c1a None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:51.166672 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645849e-954e-4822-8874-78766fad5c1a None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:51.166936 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645849e-954e-4822-8874-78766fad5c1a None admin] PATH_INFO: `/v3/roles` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:51.167597 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1645849e-954e-4822-8874-78766fad5c1a None admin] RBAC: Adding query filter params (name=reader) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:52:51.169056 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1645849e-954e-4822-8874-78766fad5c1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:51.170670 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1645849e-954e-4822-8874-78766fad5c1a None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:51.180161 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 115/241] 10.222.0.70 () {56 vars in 1101 bytes} [Fri Aug 19 15:52:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:51.187513 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1645849e-954e-4822-8874-78766fad5c1a None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:51.213042 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa075c-d988-41f4-b4bf-cb7381bf592d None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:51.244771 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:51.251241 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:51.263823 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d9e8c-4448-4f54-a916-ae9b6ac38b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:51.264930 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d9e8c-4448-4f54-a916-ae9b6ac38b37 None admin] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:51.265698 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d9e8c-4448-4f54-a916-ae9b6ac38b37 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:51.266421 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d9e8c-4448-4f54-a916-ae9b6ac38b37 None admin] PATH_INFO: `/v3/users` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:51.267418 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d9e8c-4448-4f54-a916-ae9b6ac38b37 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:51.269801 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d9e8c-4448-4f54-a916-ae9b6ac38b37 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:51.311083 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1645849e-954e-4822-8874-78766fad5c1a None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:51.348143 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f19d9d-2f52-4d2e-91f8-3c192c624cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:51.349156 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f19d9d-2f52-4d2e-91f8-3c192c624cb4 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:51.349713 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f19d9d-2f52-4d2e-91f8-3c192c624cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:51.353349 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f19d9d-2f52-4d2e-91f8-3c192c624cb4 None admin] PATH_INFO: `/v3/users/e9540bff309943beb60171e6659eccf3` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:51.359862 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 127/242] 10.222.0.70 () {60 vars in 1132 bytes} [Fri Aug 19 15:52:51 2022] POST /identity/v3/users => generated 293 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:52:51.367116 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758cf578-181a-4b68-bd3e-aa345d5aa042 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:51.367116 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758cf578-181a-4b68-bd3e-aa345d5aa042 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:51.367116 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758cf578-181a-4b68-bd3e-aa345d5aa042 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:51.367116 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 128/243] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:52:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:52:51.370150 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fbb773-99d7-417c-aea4-6438c0e1d89c None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:51.370744 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fbb773-99d7-417c-aea4-6438c0e1d89c None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:51.371257 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fbb773-99d7-417c-aea4-6438c0e1d89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:51.397203 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-b4fbb773-99d7-417c-aea4-6438c0e1d89c None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:52:51.399355 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-b4fbb773-99d7-417c-aea4-6438c0e1d89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:52:51.401046 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f19d9d-2f52-4d2e-91f8-3c192c624cb4 None admin] RBAC: Authorizing `identity:get_user(user_id=e9540bff309943beb60171e6659eccf3)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:51.402779 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f19d9d-2f52-4d2e-91f8-3c192c624cb4 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:51.408651 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 116/244] 10.222.0.70 () {56 vars in 1177 bytes} [Fri Aug 19 15:52:51 2022] GET /identity/v3/users/e9540bff309943beb60171e6659eccf3 => generated 297 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:51.423901 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f19d9d-2f52-4d2e-91f8-3c192c624cb4 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:51.502698 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 129/245] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:52:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 15:52:51.585680 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f19d9d-2f52-4d2e-91f8-3c192c624cb4 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:51.588468 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:51.624909 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eafa09-5cfc-4160-a450-ea2c4347d82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:51.625815 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eafa09-5cfc-4160-a450-ea2c4347d82d None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:51.626255 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eafa09-5cfc-4160-a450-ea2c4347d82d None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:51.626795 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eafa09-5cfc-4160-a450-ea2c4347d82d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:51.706491 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eafa09-5cfc-4160-a450-ea2c4347d82d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:51.708281 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eafa09-5cfc-4160-a450-ea2c4347d82d None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:51.826307 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 117/246] 10.222.0.70 () {58 vars in 1282 bytes} [Fri Aug 19 15:52:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:52:51.828017 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fbb773-99d7-417c-aea4-6438c0e1d89c None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:51.863674 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a982e-17bf-45ca-964a-00726554f62d None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:51.864250 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a982e-17bf-45ca-964a-00726554f62d None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:51.865026 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a982e-17bf-45ca-964a-00726554f62d None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:51.867460 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 118/247] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:52:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:52:51.872592 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6f0b3-09bc-45d5-926a-e2c123b406cc None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:51.872926 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6f0b3-09bc-45d5-926a-e2c123b406cc None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:51.873386 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6f0b3-09bc-45d5-926a-e2c123b406cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:51.888017 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:51.904180 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-f3f6f0b3-09bc-45d5-926a-e2c123b406cc None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:52:51.906938 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-f3f6f0b3-09bc-45d5-926a-e2c123b406cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:52:51.976055 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fbb773-99d7-417c-aea4-6438c0e1d89c None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:51.990301 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 119/248] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:52:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:52:51.991176 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6f0b3-09bc-45d5-926a-e2c123b406cc None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:51.995507 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:52.028873 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da65d56-95cf-469f-83e1-a2f4a747416a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:52.029681 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da65d56-95cf-469f-83e1-a2f4a747416a None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:52.030038 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da65d56-95cf-469f-83e1-a2f4a747416a None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:52.030449 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da65d56-95cf-469f-83e1-a2f4a747416a None admin] PATH_INFO: `/v3/projects/8299174a2d574620a12d3d2e42f01c55` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:52.032124 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da65d56-95cf-469f-83e1-a2f4a747416a None admin] RBAC: Authorizing `identity:get_project(project_id=8299174a2d574620a12d3d2e42f01c55)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:52.033991 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da65d56-95cf-469f-83e1-a2f4a747416a None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:52.038226 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 130/249] 10.222.0.70 () {56 vars in 1186 bytes} [Fri Aug 19 15:52:51 2022] GET /identity/v3/projects/8299174a2d574620a12d3d2e42f01c55 => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:52.042955 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076997cb-9fa4-4560-bbff-46e749901fce None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:52.043225 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076997cb-9fa4-4560-bbff-46e749901fce None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:52.043483 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076997cb-9fa4-4560-bbff-46e749901fce None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:52.044838 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 131/250] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:52:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:52:52.045544 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076997cb-9fa4-4560-bbff-46e749901fce None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:52.149075 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6f0b3-09bc-45d5-926a-e2c123b406cc None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:52.209322 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:52.210377 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076997cb-9fa4-4560-bbff-46e749901fce None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:52.221137 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd96af1-2efd-4a2f-82ec-48dd96585b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:52.221784 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd96af1-2efd-4a2f-82ec-48dd96585b63 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:52.222061 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd96af1-2efd-4a2f-82ec-48dd96585b63 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:52.224747 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd96af1-2efd-4a2f-82ec-48dd96585b63 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:52.238718 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd96af1-2efd-4a2f-82ec-48dd96585b63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:52:52.245605 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-7dd96af1-2efd-4a2f-82ec-48dd96585b63 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:52:52.245605 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:52:52.245605 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:52:52.245605 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:52:52.245605 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:52:52.245605 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:52:52.245605 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:52:52.245605 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:52:52.245605 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:52:52.245605 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:52:52.245605 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:52:52.245605 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:52:52.245605 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:52:52.245605 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:52:52.245605 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:52:52.245605 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:52:52.246525 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:52:52.246525 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:52:52.246525 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:52:52.246525 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:52:52.246525 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:52:52.246525 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:52:52.246525 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:52:52.246525 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:52:52.246525 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:52:52.246525 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:52:52.246525 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:52:52.246525 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:52:52.246525 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:52:52.246525 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:52:52.246525 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:52:52.246525 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:52:52.247474 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:52:52.247474 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:52:52.247474 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:52:52.247474 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:52:52.247474 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:52:52.247474 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:52:52.247474 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:52:52.247474 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:52:52.247474 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:52:52.247474 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:52:52.247474 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:52:52.247474 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:52:52.247474 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 120/251] 10.222.0.70 () {56 vars in 1099 bytes} [Fri Aug 19 15:52:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:52:52.248790 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade781b3-2f44-479e-abf7-e69785d28466 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:52.249074 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade781b3-2f44-479e-abf7-e69785d28466 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:52.249345 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade781b3-2f44-479e-abf7-e69785d28466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:52.271385 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-ade781b3-2f44-479e-abf7-e69785d28466 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:52:52.273108 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-ade781b3-2f44-479e-abf7-e69785d28466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:52:52.294065 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1f027-215d-402d-8768-f5a4a1794894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:52.295009 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1f027-215d-402d-8768-f5a4a1794894 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:52.295452 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1f027-215d-402d-8768-f5a4a1794894 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:52.295872 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1f027-215d-402d-8768-f5a4a1794894 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:52.296862 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c1f027-215d-402d-8768-f5a4a1794894 None admin] RBAC: Adding query filter params (role.id=2e3dded4c3734675b1978c6f9ec33c7b, scope.project.id=8299174a2d574620a12d3d2e42f01c55, user.id=e9540bff309943beb60171e6659eccf3) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:52:52.297341 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c1f027-215d-402d-8768-f5a4a1794894 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:52.299004 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c1f027-215d-402d-8768-f5a4a1794894 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:52.311742 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 132/252] 10.222.0.70 () {56 vars in 1374 bytes} [Fri Aug 19 15:52:52 2022] GET /identity/v3/role_assignments?user.id=e9540bff309943beb60171e6659eccf3&scope.project.id=8299174a2d574620a12d3d2e42f01c55&role.id=2e3dded4c3734675b1978c6f9ec33c7b => generated 259 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:52.312840 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1f027-215d-402d-8768-f5a4a1794894 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:52.395553 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 121/253] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:52:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:52:52.430599 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:52.510405 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1f027-215d-402d-8768-f5a4a1794894 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:52.566571 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a16f10-b1b2-440b-b3ee-4560502ad0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:52.567206 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a16f10-b1b2-440b-b3ee-4560502ad0c9 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:52.567483 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a16f10-b1b2-440b-b3ee-4560502ad0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:52.567758 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a16f10-b1b2-440b-b3ee-4560502ad0c9 None admin] PATH_INFO: `/v3/roles` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:52.568436 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a16f10-b1b2-440b-b3ee-4560502ad0c9 None admin] RBAC: Adding query filter params (name=member) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:52:52.568764 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a16f10-b1b2-440b-b3ee-4560502ad0c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:52.570161 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a16f10-b1b2-440b-b3ee-4560502ad0c9 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:52.588723 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 133/254] 10.222.0.70 () {56 vars in 1101 bytes} [Fri Aug 19 15:52:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:52.593826 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade781b3-2f44-479e-abf7-e69785d28466 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:52.594602 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a16f10-b1b2-440b-b3ee-4560502ad0c9 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:52.762211 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a16f10-b1b2-440b-b3ee-4560502ad0c9 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:52.767257 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:52.779608 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade781b3-2f44-479e-abf7-e69785d28466 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:52.820482 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c5f9e-6dd3-4fa6-b90f-ab6db9a82299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:52.821183 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c5f9e-6dd3-4fa6-b90f-ab6db9a82299 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:52.821460 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c5f9e-6dd3-4fa6-b90f-ab6db9a82299 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:52.821761 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c5f9e-6dd3-4fa6-b90f-ab6db9a82299 None admin] PATH_INFO: `/v3/users/d3afec39678b42589a04480695778df2` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:52.823272 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544c5f9e-6dd3-4fa6-b90f-ab6db9a82299 None admin] RBAC: Authorizing `identity:get_user(user_id=d3afec39678b42589a04480695778df2)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:52.824947 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:52.826763 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544c5f9e-6dd3-4fa6-b90f-ab6db9a82299 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:52.829233 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 134/255] 10.222.0.70 () {56 vars in 1177 bytes} [Fri Aug 19 15:52:52 2022] GET /identity/v3/users/d3afec39678b42589a04480695778df2 => generated 297 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:52:52.834816 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c5f9e-6dd3-4fa6-b90f-ab6db9a82299 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:52.852121 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01f51a-c2c9-4c2e-9b86-1db953ad9280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:52.853627 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01f51a-c2c9-4c2e-9b86-1db953ad9280 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:52.854511 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01f51a-c2c9-4c2e-9b86-1db953ad9280 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:52.856723 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01f51a-c2c9-4c2e-9b86-1db953ad9280 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:52.880829 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a01f51a-c2c9-4c2e-9b86-1db953ad9280 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:52:52.888864 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-1a01f51a-c2c9-4c2e-9b86-1db953ad9280 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:52:52.888864 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:52:52.888864 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:52:52.888864 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:52:52.888864 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:52:52.888864 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:52:52.888864 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:52:52.888864 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:52:52.888864 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:52:52.888864 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:52:52.888864 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:52:52.888864 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:52:52.888864 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:52:52.888864 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:52:52.888864 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:52:52.888864 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:52:52.889997 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:52:52.889997 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:52:52.889997 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:52:52.889997 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:52:52.889997 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:52:52.889997 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:52:52.889997 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:52:52.889997 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:52:52.889997 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:52:52.889997 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:52:52.889997 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:52:52.889997 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:52:52.889997 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:52:52.889997 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:52:52.889997 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:52:52.889997 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:52:52.890979 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:52:52.890979 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:52:52.890979 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:52:52.890979 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:52:52.890979 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:52:52.890979 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:52:52.890979 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:52:52.890979 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:52:52.890979 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:52:52.890979 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:52:52.890979 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:52:52.890979 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:52:52.894551 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 122/256] 10.222.0.70 () {56 vars in 1096 bytes} [Fri Aug 19 15:52:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:52:52.902015 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01f51a-c2c9-4c2e-9b86-1db953ad9280 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:53.000712 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c5f9e-6dd3-4fa6-b90f-ab6db9a82299 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:53.050637 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db9a6ce-9433-4d2a-8b20-a85e30bb3502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:53.051962 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db9a6ce-9433-4d2a-8b20-a85e30bb3502 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:53.052388 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db9a6ce-9433-4d2a-8b20-a85e30bb3502 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:53.052847 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db9a6ce-9433-4d2a-8b20-a85e30bb3502 None admin] PATH_INFO: `/v3/projects/8299174a2d574620a12d3d2e42f01c55` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:53.054781 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db9a6ce-9433-4d2a-8b20-a85e30bb3502 None admin] RBAC: Authorizing `identity:get_project(project_id=8299174a2d574620a12d3d2e42f01c55)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:53.056889 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db9a6ce-9433-4d2a-8b20-a85e30bb3502 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:53.059046 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 135/257] 10.222.0.70 () {56 vars in 1186 bytes} [Fri Aug 19 15:52:52 2022] GET /identity/v3/projects/8299174a2d574620a12d3d2e42f01c55 => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:53.059949 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db9a6ce-9433-4d2a-8b20-a85e30bb3502 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:53.082948 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01f51a-c2c9-4c2e-9b86-1db953ad9280 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:53.110160 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:53.175030 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2628a84-9d1f-4f6c-ba03-9254348738d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:53.175837 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2628a84-9d1f-4f6c-ba03-9254348738d2 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:53.176254 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2628a84-9d1f-4f6c-ba03-9254348738d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:53.176606 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2628a84-9d1f-4f6c-ba03-9254348738d2 None admin] PATH_INFO: `/v3/roles` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:53.177393 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2628a84-9d1f-4f6c-ba03-9254348738d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:52:53.177854 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2628a84-9d1f-4f6c-ba03-9254348738d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:53.179422 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2628a84-9d1f-4f6c-ba03-9254348738d2 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:53.184299 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db9a6ce-9433-4d2a-8b20-a85e30bb3502 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:53.195878 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 123/258] 10.222.0.70 () {56 vars in 1099 bytes} [Fri Aug 19 15:52:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:53.197305 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2628a84-9d1f-4f6c-ba03-9254348738d2 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:53.247579 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd8bb77-31ff-4c0b-8ad1-4b5f2c298a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:53.248223 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd8bb77-31ff-4c0b-8ad1-4b5f2c298a40 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:53.248500 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd8bb77-31ff-4c0b-8ad1-4b5f2c298a40 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:53.248801 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd8bb77-31ff-4c0b-8ad1-4b5f2c298a40 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:53.275984 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd8bb77-31ff-4c0b-8ad1-4b5f2c298a40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:52:53.281610 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-5cd8bb77-31ff-4c0b-8ad1-4b5f2c298a40 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 15:52:53.281610 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:52:53.281610 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:52:53.281610 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:52:53.281610 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:52:53.281610 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:52:53.281610 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:52:53.281610 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:52:53.281610 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:52:53.281610 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:52:53.281610 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:52:53.281610 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:52:53.281610 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:52:53.281610 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:52:53.281610 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:52:53.281610 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:52:53.282691 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:52:53.282691 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:52:53.282691 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:52:53.282691 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:52:53.282691 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:52:53.282691 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:52:53.282691 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:52:53.282691 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:52:53.282691 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:52:53.282691 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:52:53.282691 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:52:53.282691 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:52:53.282691 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:52:53.282691 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:52:53.282691 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:52:53.282691 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:52:53.283610 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:52:53.283610 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:52:53.283610 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:52:53.283610 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:52:53.283610 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:52:53.283610 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:52:53.283610 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:52:53.283610 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:52:53.283610 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:52:53.283610 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:52:53.283610 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 15:52:53.283610 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:52:53.287054 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:53.294218 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 136/259] 10.222.0.70 () {56 vars in 1114 bytes} [Fri Aug 19 15:52:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:52:53.295179 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd8bb77-31ff-4c0b-8ad1-4b5f2c298a40 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:53.393297 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2628a84-9d1f-4f6c-ba03-9254348738d2 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:53.473455 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ca10c-c953-404b-913c-c86ab2620c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:53.474140 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ca10c-c953-404b-913c-c86ab2620c46 None admin] REQUEST_METHOD: `PUT` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:53.474428 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ca10c-c953-404b-913c-c86ab2620c46 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:53.474707 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ca10c-c953-404b-913c-c86ab2620c46 None admin] PATH_INFO: `/v3/projects/8299174a2d574620a12d3d2e42f01c55/users/d3afec39678b42589a04480695778df2/roles/09971bc698e84205be000073fc048af2` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:53.481464 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ca10c-c953-404b-913c-c86ab2620c46 None admin] RBAC: Authorizing `identity:create_grant(project_id=8299174a2d574620a12d3d2e42f01c55, user_id=d3afec39678b42589a04480695778df2, role_id=09971bc698e84205be000073fc048af2)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:53.481615 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd8bb77-31ff-4c0b-8ad1-4b5f2c298a40 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:53.482946 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ca10c-c953-404b-913c-c86ab2620c46 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:53.485210 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:53.519453 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3fa699-649c-47c4-9e59-acb2cdceed16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:53.520086 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3fa699-649c-47c4-9e59-acb2cdceed16 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:53.520363 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3fa699-649c-47c4-9e59-acb2cdceed16 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:53.520631 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3fa699-649c-47c4-9e59-acb2cdceed16 None admin] PATH_INFO: `/v3/users/335fd9fd89384161802f3a27c0093815` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:53.521794 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3fa699-649c-47c4-9e59-acb2cdceed16 None admin] RBAC: Authorizing `identity:get_user(user_id=335fd9fd89384161802f3a27c0093815)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:53.523233 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3fa699-649c-47c4-9e59-acb2cdceed16 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:53.525210 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 137/260] 10.222.0.70 () {56 vars in 1177 bytes} [Fri Aug 19 15:52:53 2022] GET /identity/v3/users/335fd9fd89384161802f3a27c0093815 => generated 283 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:53.526211 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3fa699-649c-47c4-9e59-acb2cdceed16 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:53.631080 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3fa699-649c-47c4-9e59-acb2cdceed16 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:53.666825 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833c9f9f-c055-4b1c-b944-a5b175581101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:53.667431 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c9f9f-c055-4b1c-b944-a5b175581101 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:53.667708 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c9f9f-c055-4b1c-b944-a5b175581101 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:53.667977 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c9f9f-c055-4b1c-b944-a5b175581101 None admin] PATH_INFO: `/v3/roles` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:53.668634 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833c9f9f-c055-4b1c-b944-a5b175581101 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:52:53.668964 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833c9f9f-c055-4b1c-b944-a5b175581101 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:53.670463 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833c9f9f-c055-4b1c-b944-a5b175581101 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:53.679048 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 138/261] 10.222.0.70 () {56 vars in 1111 bytes} [Fri Aug 19 15:52:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:53.679848 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833c9f9f-c055-4b1c-b944-a5b175581101 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:53.782038 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:53.790039 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833c9f9f-c055-4b1c-b944-a5b175581101 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:53.827231 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 124/262] 10.222.0.70 () {58 vars in 1439 bytes} [Fri Aug 19 15:52:53 2022] PUT /identity/v3/projects/8299174a2d574620a12d3d2e42f01c55/users/d3afec39678b42589a04480695778df2/roles/09971bc698e84205be000073fc048af2 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:52:53.827977 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ca10c-c953-404b-913c-c86ab2620c46 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:53.833371 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be1ad68-691a-4242-94d4-659f8db6409b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:53.834052 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1ad68-691a-4242-94d4-659f8db6409b None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:53.834335 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1ad68-691a-4242-94d4-659f8db6409b None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:53.834606 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1ad68-691a-4242-94d4-659f8db6409b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:54.025920 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be1ad68-691a-4242-94d4-659f8db6409b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:54.027517 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be1ad68-691a-4242-94d4-659f8db6409b None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:54.135020 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:54.147318 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ca10c-c953-404b-913c-c86ab2620c46 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:54.157987 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:54.261450 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a285c9c9-e193-4bfc-b8d3-4a08e9431936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:54.262106 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285c9c9-e193-4bfc-b8d3-4a08e9431936 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:54.264701 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285c9c9-e193-4bfc-b8d3-4a08e9431936 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:54.264701 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285c9c9-e193-4bfc-b8d3-4a08e9431936 None admin] PATH_INFO: `/v3/users/335fd9fd89384161802f3a27c0093815` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:54.269663 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a285c9c9-e193-4bfc-b8d3-4a08e9431936 None admin] RBAC: Authorizing `identity:get_user(user_id=335fd9fd89384161802f3a27c0093815)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:54.271225 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a285c9c9-e193-4bfc-b8d3-4a08e9431936 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:54.273369 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 125/263] 10.222.0.70 () {56 vars in 1177 bytes} [Fri Aug 19 15:52:53 2022] GET /identity/v3/users/335fd9fd89384161802f3a27c0093815 => generated 283 bytes in 446 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:54.281832 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a285c9c9-e193-4bfc-b8d3-4a08e9431936 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:54.346454 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 139/264] 10.222.0.70 () {58 vars in 1282 bytes} [Fri Aug 19 15:52:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 667 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:52:54.360696 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be1ad68-691a-4242-94d4-659f8db6409b None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:54.558298 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be1ad68-691a-4242-94d4-659f8db6409b None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:54.610328 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:54.623871 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1986c1e8-893f-4332-9062-e993eb9582f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:54.624518 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986c1e8-893f-4332-9062-e993eb9582f1 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:54.624823 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986c1e8-893f-4332-9062-e993eb9582f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:54.625098 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986c1e8-893f-4332-9062-e993eb9582f1 None admin] PATH_INFO: `/v3/projects/8299174a2d574620a12d3d2e42f01c55` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:54.630172 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1986c1e8-893f-4332-9062-e993eb9582f1 None admin] RBAC: Authorizing `identity:get_project(project_id=8299174a2d574620a12d3d2e42f01c55)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:54.635045 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1986c1e8-893f-4332-9062-e993eb9582f1 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:54.635045 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 140/265] 10.222.0.70 () {56 vars in 1186 bytes} [Fri Aug 19 15:52:54 2022] GET /identity/v3/projects/8299174a2d574620a12d3d2e42f01c55 => generated 302 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:54.641479 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1986c1e8-893f-4332-9062-e993eb9582f1 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:54.731653 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a285c9c9-e193-4bfc-b8d3-4a08e9431936 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:54.791337 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1986c1e8-893f-4332-9062-e993eb9582f1 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:54.807806 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b54ae6f-2394-417b-9973-0890070479e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:54.808480 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54ae6f-2394-417b-9973-0890070479e6 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:54.808766 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54ae6f-2394-417b-9973-0890070479e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:54.809045 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54ae6f-2394-417b-9973-0890070479e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:54.835380 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c00b8f-f6e0-4e71-a4ac-14a80d6e476c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:54.836579 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c00b8f-f6e0-4e71-a4ac-14a80d6e476c None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:54.836988 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c00b8f-f6e0-4e71-a4ac-14a80d6e476c None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:54.837301 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c00b8f-f6e0-4e71-a4ac-14a80d6e476c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:54.838056 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c00b8f-f6e0-4e71-a4ac-14a80d6e476c None admin] RBAC: Adding query filter params (role.id=2f6cb7d6ec874879972a12a63d61068d, scope.project.id=8299174a2d574620a12d3d2e42f01c55, user.id=335fd9fd89384161802f3a27c0093815) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:52:54.838366 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c00b8f-f6e0-4e71-a4ac-14a80d6e476c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:54.839834 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c00b8f-f6e0-4e71-a4ac-14a80d6e476c None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:54.846308 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 141/266] 10.222.0.70 () {56 vars in 1374 bytes} [Fri Aug 19 15:52:54 2022] GET /identity/v3/role_assignments?user.id=335fd9fd89384161802f3a27c0093815&scope.project.id=8299174a2d574620a12d3d2e42f01c55&role.id=2f6cb7d6ec874879972a12a63d61068d => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:52:54.852695 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d853e-924a-43fe-9790-48f0fe497a7f None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:54.852695 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d853e-924a-43fe-9790-48f0fe497a7f None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:54.852695 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d853e-924a-43fe-9790-48f0fe497a7f None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:54.852695 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 142/267] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:52:54.852695 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb8b34-7adc-4804-ad84-08221025b667 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:54.852695 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb8b34-7adc-4804-ad84-08221025b667 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:54.853273 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb8b34-7adc-4804-ad84-08221025b667 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:54.853273 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 143/268] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:52:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:52:54.857827 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a5280-92f8-474a-b1e7-51c01107f93b None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:54.858114 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a5280-92f8-474a-b1e7-51c01107f93b None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:54.858390 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a5280-92f8-474a-b1e7-51c01107f93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:54.878615 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:54.888524 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-661a5280-92f8-474a-b1e7-51c01107f93b None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:52:54.893010 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-661a5280-92f8-474a-b1e7-51c01107f93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:52:54.939962 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b54ae6f-2394-417b-9973-0890070479e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:54.941539 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b54ae6f-2394-417b-9973-0890070479e6 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:55.024075 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:55.052223 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 144/269] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:52:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:52:55.055748 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc7306-3057-4b55-b977-bfc32c4229c3 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:55.058365 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc7306-3057-4b55-b977-bfc32c4229c3 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:55.059026 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc7306-3057-4b55-b977-bfc32c4229c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:55.098702 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 126/270] 10.222.0.70 () {58 vars in 1282 bytes} [Fri Aug 19 15:52:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 817 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:52:55.100340 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-e6cc7306-3057-4b55-b977-bfc32c4229c3 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:52:55.101795 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-e6cc7306-3057-4b55-b977-bfc32c4229c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:52:55.109823 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b54ae6f-2394-417b-9973-0890070479e6 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:55.224373 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 145/271] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:52:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:52:55.250344 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:55.289068 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b54ae6f-2394-417b-9973-0890070479e6 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:55.351570 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ecdaae-0b94-4458-af03-9624a51cb4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:55.352202 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ecdaae-0b94-4458-af03-9624a51cb4cc None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:55.352480 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ecdaae-0b94-4458-af03-9624a51cb4cc None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:55.352814 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ecdaae-0b94-4458-af03-9624a51cb4cc None admin] PATH_INFO: `/v3/projects/8299174a2d574620a12d3d2e42f01c55` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:55.354448 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ecdaae-0b94-4458-af03-9624a51cb4cc None admin] RBAC: Authorizing `identity:get_project(project_id=8299174a2d574620a12d3d2e42f01c55)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:55.356328 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ecdaae-0b94-4458-af03-9624a51cb4cc None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:55.358384 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 127/272] 10.222.0.70 () {56 vars in 1186 bytes} [Fri Aug 19 15:52:55 2022] GET /identity/v3/projects/8299174a2d574620a12d3d2e42f01c55 => generated 302 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:55.366861 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc7306-3057-4b55-b977-bfc32c4229c3 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:55.518890 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc7306-3057-4b55-b977-bfc32c4229c3 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:55.527798 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c5509-0be8-4e77-92ab-7c3a0c146ede None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:55.528130 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c5509-0be8-4e77-92ab-7c3a0c146ede None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:55.528417 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c5509-0be8-4e77-92ab-7c3a0c146ede None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:55.530799 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 128/273] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:52:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 15:52:55.537014 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b56355f-fd96-48bd-9973-1a48044a9cf7 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:55.537289 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b56355f-fd96-48bd-9973-1a48044a9cf7 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:55.537560 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b56355f-fd96-48bd-9973-1a48044a9cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:55.559752 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-8b56355f-fd96-48bd-9973-1a48044a9cf7 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:52:55.561490 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-8b56355f-fd96-48bd-9973-1a48044a9cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:52:55.561924 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:55.585355 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431039ef-cb02-4f59-bf3f-0c9e01c48790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:55.586371 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431039ef-cb02-4f59-bf3f-0c9e01c48790 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:55.587078 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431039ef-cb02-4f59-bf3f-0c9e01c48790 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:55.588115 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431039ef-cb02-4f59-bf3f-0c9e01c48790 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:55.589750 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431039ef-cb02-4f59-bf3f-0c9e01c48790 None admin] RBAC: Adding query filter params (role.id=294bcd6132ef46d48aff3efa4d77fa0a, scope.project.id=8299174a2d574620a12d3d2e42f01c55, user.id=335fd9fd89384161802f3a27c0093815) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:52:55.590309 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431039ef-cb02-4f59-bf3f-0c9e01c48790 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:55.593110 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431039ef-cb02-4f59-bf3f-0c9e01c48790 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:55.620777 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 146/274] 10.222.0.70 () {56 vars in 1374 bytes} [Fri Aug 19 15:52:55 2022] GET /identity/v3/role_assignments?user.id=335fd9fd89384161802f3a27c0093815&scope.project.id=8299174a2d574620a12d3d2e42f01c55&role.id=294bcd6132ef46d48aff3efa4d77fa0a => generated 608 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:55.620777 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431039ef-cb02-4f59-bf3f-0c9e01c48790 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:55.662472 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 129/275] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:52:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:52:55.722620 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b56355f-fd96-48bd-9973-1a48044a9cf7 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:55.785150 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431039ef-cb02-4f59-bf3f-0c9e01c48790 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:55.839575 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea85a28e-e14d-4504-a44a-e84b464ce3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:55.840208 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea85a28e-e14d-4504-a44a-e84b464ce3ad None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:55.840488 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea85a28e-e14d-4504-a44a-e84b464ce3ad None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:55.840787 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea85a28e-e14d-4504-a44a-e84b464ce3ad None admin] PATH_INFO: `/v3/domains/default` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:55.845515 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea85a28e-e14d-4504-a44a-e84b464ce3ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:55.847008 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea85a28e-e14d-4504-a44a-e84b464ce3ad None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:55.852694 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 147/276] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:52:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:55.867445 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:55.869662 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea85a28e-e14d-4504-a44a-e84b464ce3ad None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:55.897249 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b56355f-fd96-48bd-9973-1a48044a9cf7 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:55.934763 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:55.944620 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c574cd40-0b3e-4773-91b7-230908154541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:55.949858 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574cd40-0b3e-4773-91b7-230908154541 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:55.949858 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574cd40-0b3e-4773-91b7-230908154541 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:55.949858 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574cd40-0b3e-4773-91b7-230908154541 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:55.961556 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c574cd40-0b3e-4773-91b7-230908154541 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:52:55.968612 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-c574cd40-0b3e-4773-91b7-230908154541 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:52:55.968612 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:52:55.968612 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:52:55.968612 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:52:55.968612 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:52:55.968612 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:52:55.968612 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:52:55.968612 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:52:55.968612 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:52:55.968612 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:52:55.968612 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:52:55.968612 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:52:55.968612 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:52:55.968612 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:52:55.968612 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:52:55.968612 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:52:55.969612 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:52:55.969612 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:52:55.969612 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:52:55.969612 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:52:55.969612 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:52:55.969612 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:52:55.969612 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:52:55.969612 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:52:55.969612 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:52:55.969612 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:52:55.969612 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:52:55.969612 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:52:55.969612 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:52:55.969612 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:52:55.969612 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:52:55.969612 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:52:55.970532 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:52:55.970532 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:52:55.970532 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:52:55.970532 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:52:55.970532 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:52:55.970532 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:52:55.970532 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:52:55.970532 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:52:55.970532 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:52:55.970532 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:52:55.970532 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:52:55.970532 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:52:55.974817 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 130/277] 10.222.0.70 () {56 vars in 1099 bytes} [Fri Aug 19 15:52:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:52:55.976146 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c574cd40-0b3e-4773-91b7-230908154541 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:55.993029 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea85a28e-e14d-4504-a44a-e84b464ce3ad None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:56.034995 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4f1b4-9ed2-4813-86f0-30e659ab986e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:56.035936 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4f1b4-9ed2-4813-86f0-30e659ab986e None admin] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:56.036431 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4f1b4-9ed2-4813-86f0-30e659ab986e None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:56.036959 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4f1b4-9ed2-4813-86f0-30e659ab986e None admin] PATH_INFO: `/v3/users` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:56.037824 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c4f1b4-9ed2-4813-86f0-30e659ab986e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:56.039494 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c4f1b4-9ed2-4813-86f0-30e659ab986e None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:56.093901 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c574cd40-0b3e-4773-91b7-230908154541 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:56.129480 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:56.136173 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbf73d-6e76-452f-8bd8-b5524e949b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:56.136816 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbf73d-6e76-452f-8bd8-b5524e949b5d None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:56.137097 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbf73d-6e76-452f-8bd8-b5524e949b5d None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:56.137369 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbf73d-6e76-452f-8bd8-b5524e949b5d None admin] PATH_INFO: `/v3/roles` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:56.138029 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cbf73d-6e76-452f-8bd8-b5524e949b5d None admin] RBAC: Adding query filter params (name=member) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:52:56.138336 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cbf73d-6e76-452f-8bd8-b5524e949b5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:56.139719 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cbf73d-6e76-452f-8bd8-b5524e949b5d None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:56.153040 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 131/278] 10.222.0.70 () {56 vars in 1101 bytes} [Fri Aug 19 15:52:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:52:56.153040 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbf73d-6e76-452f-8bd8-b5524e949b5d None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:56.159922 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 148/279] 10.222.0.70 () {60 vars in 1132 bytes} [Fri Aug 19 15:52:55 2022] POST /identity/v3/users => generated 293 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:52:56.163766 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4f1b4-9ed2-4813-86f0-30e659ab986e None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:56.302093 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbf73d-6e76-452f-8bd8-b5524e949b5d None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:56.307113 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4f1b4-9ed2-4813-86f0-30e659ab986e None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:56.320393 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:56.375432 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a36096-1a83-45e0-b49c-e335732bf574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:56.376190 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19143f6-fbae-44a7-baab-74efb778b144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:56.376771 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a36096-1a83-45e0-b49c-e335732bf574 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:56.376889 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19143f6-fbae-44a7-baab-74efb778b144 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:56.377409 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19143f6-fbae-44a7-baab-74efb778b144 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:56.377715 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19143f6-fbae-44a7-baab-74efb778b144 None admin] PATH_INFO: `/v3/users/3495c88025534cb4a23e4c64548db7dc` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:56.378067 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a36096-1a83-45e0-b49c-e335732bf574 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:56.378731 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a36096-1a83-45e0-b49c-e335732bf574 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:56.397227 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a36096-1a83-45e0-b49c-e335732bf574 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:52:56.402905 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-21a36096-1a83-45e0-b49c-e335732bf574 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 15:52:56.402905 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:52:56.402905 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:52:56.402905 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:52:56.402905 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:52:56.402905 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:52:56.402905 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:52:56.402905 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:52:56.402905 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:52:56.402905 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:52:56.402905 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:52:56.402905 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:52:56.402905 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:52:56.402905 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:52:56.402905 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:52:56.402905 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:52:56.403850 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:52:56.403850 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:52:56.403850 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:52:56.403850 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:52:56.403850 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:52:56.403850 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:52:56.403850 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:52:56.403850 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:52:56.403850 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:52:56.403850 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:52:56.403850 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:52:56.403850 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:52:56.403850 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:52:56.403850 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:52:56.403850 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:52:56.403850 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:52:56.404638 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:52:56.404638 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:52:56.404638 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:52:56.404638 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:52:56.404638 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:52:56.404638 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:52:56.404638 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:52:56.404638 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:52:56.404638 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:52:56.404638 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:52:56.404638 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 15:52:56.404638 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:52:56.404638 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 132/280] 10.222.0.70 () {56 vars in 1099 bytes} [Fri Aug 19 15:52:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:52:56.405733 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19143f6-fbae-44a7-baab-74efb778b144 None admin] RBAC: Authorizing `identity:get_user(user_id=3495c88025534cb4a23e4c64548db7dc)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:56.407710 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19143f6-fbae-44a7-baab-74efb778b144 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:56.411036 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 149/281] 10.222.0.70 () {56 vars in 1177 bytes} [Fri Aug 19 15:52:56 2022] GET /identity/v3/users/3495c88025534cb4a23e4c64548db7dc => generated 293 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:56.413521 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a36096-1a83-45e0-b49c-e335732bf574 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:56.417170 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19143f6-fbae-44a7-baab-74efb778b144 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:56.495879 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:56.570885 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a36096-1a83-45e0-b49c-e335732bf574 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:56.573550 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19143f6-fbae-44a7-baab-74efb778b144 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:56.622655 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e7f3e-fbdd-443e-be8e-d6f6e4017d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:56.623270 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e7f3e-fbdd-443e-be8e-d6f6e4017d90 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:56.623542 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e7f3e-fbdd-443e-be8e-d6f6e4017d90 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:56.623831 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e7f3e-fbdd-443e-be8e-d6f6e4017d90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:56.624833 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5e7f3e-fbdd-443e-be8e-d6f6e4017d90 None admin] RBAC: Adding query filter params (role.id=09971bc698e84205be000073fc048af2, user.id=3495c88025534cb4a23e4c64548db7dc, scope.system=all) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:52:56.625142 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5e7f3e-fbdd-443e-be8e-d6f6e4017d90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:56.626215 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38c3639-abbe-4d3a-9683-eaaf6e377bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:56.626581 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5e7f3e-fbdd-443e-be8e-d6f6e4017d90 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:56.626826 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c3639-abbe-4d3a-9683-eaaf6e377bc3 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:56.627358 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c3639-abbe-4d3a-9683-eaaf6e377bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:56.627631 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c3639-abbe-4d3a-9683-eaaf6e377bc3 None admin] PATH_INFO: `/v3/roles` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:56.628300 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38c3639-abbe-4d3a-9683-eaaf6e377bc3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:52:56.628607 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38c3639-abbe-4d3a-9683-eaaf6e377bc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:56.631494 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38c3639-abbe-4d3a-9683-eaaf6e377bc3 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:56.634929 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 150/282] 10.222.0.70 () {56 vars in 1308 bytes} [Fri Aug 19 15:52:56 2022] GET /identity/v3/role_assignments?user.id=3495c88025534cb4a23e4c64548db7dc&scope.system=all&role.id=09971bc698e84205be000073fc048af2 => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:52:56.641774 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 133/283] 10.222.0.70 () {56 vars in 1101 bytes} [Fri Aug 19 15:52:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:56.649602 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e7f3e-fbdd-443e-be8e-d6f6e4017d90 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:56.694521 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:56.774776 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e7f3e-fbdd-443e-be8e-d6f6e4017d90 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:56.815593 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a166e48-a0fa-4f88-9529-757ab5b9b8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:56.816251 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a166e48-a0fa-4f88-9529-757ab5b9b8fc None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:56.816562 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a166e48-a0fa-4f88-9529-757ab5b9b8fc None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:56.816869 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a166e48-a0fa-4f88-9529-757ab5b9b8fc None admin] PATH_INFO: `/v3/users/e9540bff309943beb60171e6659eccf3` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:56.818106 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a166e48-a0fa-4f88-9529-757ab5b9b8fc None admin] RBAC: Authorizing `identity:get_user(user_id=e9540bff309943beb60171e6659eccf3)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:56.819640 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a166e48-a0fa-4f88-9529-757ab5b9b8fc None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:56.821751 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 151/284] 10.222.0.70 () {56 vars in 1177 bytes} [Fri Aug 19 15:52:56 2022] GET /identity/v3/users/e9540bff309943beb60171e6659eccf3 => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:56.827613 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38c3639-abbe-4d3a-9683-eaaf6e377bc3 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:56.967587 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38c3639-abbe-4d3a-9683-eaaf6e377bc3 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:56.988528 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:57.034060 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e092c-b7a3-4ec5-b87b-a024ebcf2d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:57.034703 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e092c-b7a3-4ec5-b87b-a024ebcf2d52 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:57.034978 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e092c-b7a3-4ec5-b87b-a024ebcf2d52 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:57.035246 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e092c-b7a3-4ec5-b87b-a024ebcf2d52 None admin] PATH_INFO: `/v3/projects/8299174a2d574620a12d3d2e42f01c55` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:57.036415 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681e092c-b7a3-4ec5-b87b-a024ebcf2d52 None admin] RBAC: Authorizing `identity:get_project(project_id=8299174a2d574620a12d3d2e42f01c55)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:57.037975 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681e092c-b7a3-4ec5-b87b-a024ebcf2d52 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:57.039810 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 134/285] 10.222.0.70 () {56 vars in 1186 bytes} [Fri Aug 19 15:52:56 2022] GET /identity/v3/projects/8299174a2d574620a12d3d2e42f01c55 => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:57.045939 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a166e48-a0fa-4f88-9529-757ab5b9b8fc None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:57.076992 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613119be-103e-4138-8349-b296566c8962 None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:57.077323 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613119be-103e-4138-8349-b296566c8962 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:57.077526 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613119be-103e-4138-8349-b296566c8962 None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:57.079148 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 135/286] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:52:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 15:52:57.084575 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24174dd-4253-402d-bac6-0e0db0f2d61c None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:57.084997 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24174dd-4253-402d-bac6-0e0db0f2d61c None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:57.084997 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24174dd-4253-402d-bac6-0e0db0f2d61c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:57.108232 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-e24174dd-4253-402d-bac6-0e0db0f2d61c None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:52:57.109507 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-e24174dd-4253-402d-bac6-0e0db0f2d61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:52:57.215006 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 136/287] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:52:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 15:52:57.236242 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:57.240435 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a166e48-a0fa-4f88-9529-757ab5b9b8fc None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:57.300122 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a393ddc-b0e5-463a-a6e2-01f2e7e7d151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:57.300806 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a393ddc-b0e5-463a-a6e2-01f2e7e7d151 None admin] REQUEST_METHOD: `PUT` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:57.301084 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a393ddc-b0e5-463a-a6e2-01f2e7e7d151 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:57.301353 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a393ddc-b0e5-463a-a6e2-01f2e7e7d151 None admin] PATH_INFO: `/v3/projects/8299174a2d574620a12d3d2e42f01c55/users/e9540bff309943beb60171e6659eccf3/roles/2e3dded4c3734675b1978c6f9ec33c7b` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:57.305940 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a393ddc-b0e5-463a-a6e2-01f2e7e7d151 None admin] RBAC: Authorizing `identity:create_grant(project_id=8299174a2d574620a12d3d2e42f01c55, user_id=e9540bff309943beb60171e6659eccf3, role_id=2e3dded4c3734675b1978c6f9ec33c7b)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:57.308179 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a393ddc-b0e5-463a-a6e2-01f2e7e7d151 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:57.382968 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 152/288] 10.222.0.70 () {58 vars in 1439 bytes} [Fri Aug 19 15:52:57 2022] PUT /identity/v3/projects/8299174a2d574620a12d3d2e42f01c55/users/e9540bff309943beb60171e6659eccf3/roles/2e3dded4c3734675b1978c6f9ec33c7b => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:52:57.649131 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24174dd-4253-402d-bac6-0e0db0f2d61c None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:57.766041 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24174dd-4253-402d-bac6-0e0db0f2d61c None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:57.781776 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:57.814356 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc802e-28fb-4be1-a8de-5246357be8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:57.815424 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc802e-28fb-4be1-a8de-5246357be8ee None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:57.815897 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc802e-28fb-4be1-a8de-5246357be8ee None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:57.816367 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc802e-28fb-4be1-a8de-5246357be8ee None admin] PATH_INFO: `/v3/roles/member` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:57.838957 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc802e-28fb-4be1-a8de-5246357be8ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:52:57.843670 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-55bc802e-28fb-4be1-a8de-5246357be8ee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:52:57.843670 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:52:57.843670 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:52:57.843670 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:52:57.843670 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:52:57.843670 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:52:57.843670 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:52:57.843670 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:52:57.843670 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:52:57.843670 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:52:57.843670 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:52:57.843670 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:52:57.843670 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:52:57.843670 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:52:57.843670 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:52:57.843670 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:52:57.844611 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:52:57.844611 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:52:57.844611 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:52:57.844611 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:52:57.844611 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:52:57.844611 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:52:57.844611 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:52:57.844611 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:52:57.844611 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:52:57.844611 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:52:57.844611 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:52:57.844611 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:52:57.844611 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:52:57.844611 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:52:57.844611 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:52:57.844611 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:52:57.845437 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:52:57.845437 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:52:57.845437 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:52:57.845437 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:52:57.845437 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:52:57.845437 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:52:57.845437 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:52:57.845437 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:52:57.845437 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:52:57.845437 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:52:57.845437 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:52:57.845437 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:52:57.845437 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 137/289] 10.222.0.70 () {56 vars in 1099 bytes} [Fri Aug 19 15:52:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:52:57.851086 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a393ddc-b0e5-463a-a6e2-01f2e7e7d151 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:57.997794 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a393ddc-b0e5-463a-a6e2-01f2e7e7d151 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:58.038521 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f106e8-98b7-445a-9cbd-2a6efcbe7481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:58.039138 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f106e8-98b7-445a-9cbd-2a6efcbe7481 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:58.039411 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f106e8-98b7-445a-9cbd-2a6efcbe7481 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:58.039677 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f106e8-98b7-445a-9cbd-2a6efcbe7481 None admin] PATH_INFO: `/v3/roles` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:58.040864 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f106e8-98b7-445a-9cbd-2a6efcbe7481 None admin] RBAC: Adding query filter params (name=member) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:52:58.041286 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f106e8-98b7-445a-9cbd-2a6efcbe7481 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:58.042775 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f106e8-98b7-445a-9cbd-2a6efcbe7481 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:58.052218 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 153/290] 10.222.0.70 () {56 vars in 1101 bytes} [Fri Aug 19 15:52:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:58.061764 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc802e-28fb-4be1-a8de-5246357be8ee None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:58.205804 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc802e-28fb-4be1-a8de-5246357be8ee None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:58.248813 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02bac6-78e0-4f54-b2cb-89586eb0d85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:58.249672 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02bac6-78e0-4f54-b2cb-89586eb0d85a None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:58.250087 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02bac6-78e0-4f54-b2cb-89586eb0d85a None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:58.250620 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02bac6-78e0-4f54-b2cb-89586eb0d85a None admin] PATH_INFO: `/v3/users/d3afec39678b42589a04480695778df2` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:58.257364 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca02bac6-78e0-4f54-b2cb-89586eb0d85a None admin] RBAC: Authorizing `identity:get_user(user_id=d3afec39678b42589a04480695778df2)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:58.259000 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca02bac6-78e0-4f54-b2cb-89586eb0d85a None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:58.260949 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 138/291] 10.222.0.70 () {56 vars in 1177 bytes} [Fri Aug 19 15:52:58 2022] GET /identity/v3/users/d3afec39678b42589a04480695778df2 => generated 297 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:58.266677 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f106e8-98b7-445a-9cbd-2a6efcbe7481 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:58.301985 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:58.396349 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f106e8-98b7-445a-9cbd-2a6efcbe7481 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:58.468357 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7270793e-bd7b-486d-8e7d-30322d073e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:58.468930 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270793e-bd7b-486d-8e7d-30322d073e44 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:58.469208 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270793e-bd7b-486d-8e7d-30322d073e44 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:58.469479 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270793e-bd7b-486d-8e7d-30322d073e44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:58.543513 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7270793e-bd7b-486d-8e7d-30322d073e44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:58.545257 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7270793e-bd7b-486d-8e7d-30322d073e44 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:58.567820 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:58.651475 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 154/292] 10.222.0.70 () {58 vars in 1282 bytes} [Fri Aug 19 15:52:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:52:58.656744 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02bac6-78e0-4f54-b2cb-89586eb0d85a None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:58.725005 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:58.815715 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02bac6-78e0-4f54-b2cb-89586eb0d85a None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:58.866472 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ff5a9-e021-4e9b-a219-486465d11523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:58.867106 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ff5a9-e021-4e9b-a219-486465d11523 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:58.867381 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ff5a9-e021-4e9b-a219-486465d11523 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:58.867649 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ff5a9-e021-4e9b-a219-486465d11523 None admin] PATH_INFO: `/v3/projects/8299174a2d574620a12d3d2e42f01c55` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:58.870365 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424ff5a9-e021-4e9b-a219-486465d11523 None admin] RBAC: Authorizing `identity:get_project(project_id=8299174a2d574620a12d3d2e42f01c55)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:58.871822 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424ff5a9-e021-4e9b-a219-486465d11523 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:58.873857 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 139/293] 10.222.0.70 () {56 vars in 1186 bytes} [Fri Aug 19 15:52:58 2022] GET /identity/v3/projects/8299174a2d574620a12d3d2e42f01c55 => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:58.879728 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7270793e-bd7b-486d-8e7d-30322d073e44 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:58.996271 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7270793e-bd7b-486d-8e7d-30322d073e44 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:52:59.019752 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:52:59.040329 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39709dd7-3bcb-46cc-b4e7-ba1ba9479972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:52:59.041703 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39709dd7-3bcb-46cc-b4e7-ba1ba9479972 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:59.041973 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39709dd7-3bcb-46cc-b4e7-ba1ba9479972 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:59.042242 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39709dd7-3bcb-46cc-b4e7-ba1ba9479972 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:59.042967 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39709dd7-3bcb-46cc-b4e7-ba1ba9479972 None admin] RBAC: Adding query filter params (role.id=09971bc698e84205be000073fc048af2, scope.project.id=8299174a2d574620a12d3d2e42f01c55, user.id=d3afec39678b42589a04480695778df2) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:52:59.043268 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39709dd7-3bcb-46cc-b4e7-ba1ba9479972 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:52:59.044953 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39709dd7-3bcb-46cc-b4e7-ba1ba9479972 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:52:59.051588 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 155/294] 10.222.0.70 () {56 vars in 1374 bytes} [Fri Aug 19 15:52:58 2022] GET /identity/v3/role_assignments?user.id=d3afec39678b42589a04480695778df2&scope.project.id=8299174a2d574620a12d3d2e42f01c55&role.id=09971bc698e84205be000073fc048af2 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:52:59.403820 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decff4d4-a993-4aac-8b0c-1258d2d34d55 None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:59.404140 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decff4d4-a993-4aac-8b0c-1258d2d34d55 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:59.404363 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decff4d4-a993-4aac-8b0c-1258d2d34d55 None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:59.405891 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 140/295] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:52:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:52:59.411583 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b03c26-db91-4e6a-9a99-91bb57a94222 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:59.412697 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b03c26-db91-4e6a-9a99-91bb57a94222 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:59.413186 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b03c26-db91-4e6a-9a99-91bb57a94222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:59.434519 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-e1b03c26-db91-4e6a-9a99-91bb57a94222 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:52:59.436032 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-e1b03c26-db91-4e6a-9a99-91bb57a94222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:52:59.453336 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf888d3-09f8-4420-b07b-04239e651cb9 None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:59.454010 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf888d3-09f8-4420-b07b-04239e651cb9 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:59.454486 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf888d3-09f8-4420-b07b-04239e651cb9 None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:59.456271 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 141/296] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:52:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:52:59.461837 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119da43-983e-4f2c-a059-04fe13cd2adb None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:59.462427 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119da43-983e-4f2c-a059-04fe13cd2adb None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:59.463087 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119da43-983e-4f2c-a059-04fe13cd2adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:59.482709 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-e119da43-983e-4f2c-a059-04fe13cd2adb None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:52:59.484286 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-e119da43-983e-4f2c-a059-04fe13cd2adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:52:59.520719 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 156/297] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:52:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:52:59.520719 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f61302-fbce-4503-89aa-ab24f868ea2c None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:59.520719 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f61302-fbce-4503-89aa-ab24f868ea2c None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:59.520719 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f61302-fbce-4503-89aa-ab24f868ea2c None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:59.520719 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 157/298] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:52:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:52:59.527694 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba8d8d-be61-410e-9b55-507a4fcec96d None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:52:59.527694 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba8d8d-be61-410e-9b55-507a4fcec96d None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:52:59.527694 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba8d8d-be61-410e-9b55-507a4fcec96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:52:59.548333 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-baba8d8d-be61-410e-9b55-507a4fcec96d None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:52:59.549654 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-baba8d8d-be61-410e-9b55-507a4fcec96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:52:59.574209 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 142/299] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:52:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:52:59.644897 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 158/300] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:52:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 15:52:59.897255 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119da43-983e-4f2c-a059-04fe13cd2adb None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:59.921772 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba8d8d-be61-410e-9b55-507a4fcec96d None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:52:59.941036 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:00.019288 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119da43-983e-4f2c-a059-04fe13cd2adb None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:00.037323 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:00.046760 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba8d8d-be61-410e-9b55-507a4fcec96d None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:00.068542 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ebaadd-13c7-4b8b-ba4a-73408c5b5b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:00.069297 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebaadd-13c7-4b8b-ba4a-73408c5b5b2e None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:00.069574 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebaadd-13c7-4b8b-ba4a-73408c5b5b2e None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:00.069840 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebaadd-13c7-4b8b-ba4a-73408c5b5b2e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:00.091284 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ebaadd-13c7-4b8b-ba4a-73408c5b5b2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:53:00.097614 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7452d4b2-98fb-4e68-98d5-6c8294e727f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:00.097905 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-73ebaadd-13c7-4b8b-ba4a-73408c5b5b2e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 15:53:00.097905 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:00.097905 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:00.097905 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:00.097905 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:00.097905 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:00.097905 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:00.097905 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:00.097905 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:00.097905 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:00.097905 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:00.097905 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:00.097905 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:53:00.097905 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:53:00.097905 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:53:00.097905 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:53:00.098950 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:53:00.098950 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:53:00.098950 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:53:00.098950 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:53:00.098950 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:00.098950 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:00.098950 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:00.098950 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:00.098950 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:00.098950 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:00.098950 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:00.098950 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:00.098950 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:00.098950 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:00.098950 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:00.098950 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:00.100114 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:00.100114 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:00.100114 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:00.100114 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:00.100114 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:53:00.100114 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:53:00.100114 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:53:00.100114 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:53:00.100114 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:53:00.100114 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:53:00.100114 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 15:53:00.100114 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:53:00.101077 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7452d4b2-98fb-4e68-98d5-6c8294e727f7 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:00.101364 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7452d4b2-98fb-4e68-98d5-6c8294e727f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:00.101635 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7452d4b2-98fb-4e68-98d5-6c8294e727f7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:00.104712 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 143/301] 10.222.0.70 () {56 vars in 1099 bytes} [Fri Aug 19 15:52:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:00.104858 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ebaadd-13c7-4b8b-ba4a-73408c5b5b2e None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:00.118236 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7452d4b2-98fb-4e68-98d5-6c8294e727f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:53:00.123790 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-7452d4b2-98fb-4e68-98d5-6c8294e727f7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:53:00.123790 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:00.123790 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:00.123790 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:00.123790 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:00.123790 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:00.123790 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:00.123790 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:00.123790 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:00.123790 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:00.123790 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:00.123790 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:00.123790 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:53:00.123790 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:53:00.123790 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:53:00.123790 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:53:00.124659 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:53:00.124659 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:53:00.124659 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:53:00.124659 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:53:00.124659 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:00.124659 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:00.124659 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:00.124659 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:00.124659 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:00.124659 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:00.124659 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:00.124659 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:00.124659 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:00.124659 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:00.124659 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:00.124659 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:00.125482 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:00.125482 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:00.125482 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:00.125482 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:00.125482 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:53:00.125482 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:53:00.125482 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:53:00.125482 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:53:00.125482 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:53:00.125482 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:53:00.125482 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:53:00.125482 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:00.128970 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 159/302] 10.222.0.70 () {56 vars in 1099 bytes} [Fri Aug 19 15:52:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:00.130621 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7452d4b2-98fb-4e68-98d5-6c8294e727f7 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:00.245158 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7452d4b2-98fb-4e68-98d5-6c8294e727f7 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:00.249079 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:00.252427 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:00.256303 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ebaadd-13c7-4b8b-ba4a-73408c5b5b2e None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:00.282090 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbce5bb-b516-4c4b-8af0-17f0fd311756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:00.282686 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbce5bb-b516-4c4b-8af0-17f0fd311756 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:00.282959 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbce5bb-b516-4c4b-8af0-17f0fd311756 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:00.283227 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbce5bb-b516-4c4b-8af0-17f0fd311756 None admin] PATH_INFO: `/v3/roles` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:00.283875 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbce5bb-b516-4c4b-8af0-17f0fd311756 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:00.284173 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbce5bb-b516-4c4b-8af0-17f0fd311756 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:00.285587 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbce5bb-b516-4c4b-8af0-17f0fd311756 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:00.292205 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641fd49c-f4b6-4f92-b761-3cd433519f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:00.292869 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fd49c-f4b6-4f92-b761-3cd433519f19 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:00.293148 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fd49c-f4b6-4f92-b761-3cd433519f19 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:00.293418 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fd49c-f4b6-4f92-b761-3cd433519f19 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:00.294526 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641fd49c-f4b6-4f92-b761-3cd433519f19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:00.294663 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 160/303] 10.222.0.70 () {56 vars in 1101 bytes} [Fri Aug 19 15:53:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:00.295393 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbce5bb-b516-4c4b-8af0-17f0fd311756 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:00.296037 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641fd49c-f4b6-4f92-b761-3cd433519f19 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:00.297793 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 144/304] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:53:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:00.302035 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8afad-33f3-4f89-8f63-b23f3f7ea479 None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:00.302317 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8afad-33f3-4f89-8f63-b23f3f7ea479 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:00.302589 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8afad-33f3-4f89-8f63-b23f3f7ea479 None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:00.303823 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 145/305] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:53:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:53:00.305254 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8afad-33f3-4f89-8f63-b23f3f7ea479 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:00.402492 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbce5bb-b516-4c4b-8af0-17f0fd311756 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:00.411547 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8afad-33f3-4f89-8f63-b23f3f7ea479 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:00.437914 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360af14-bba1-4403-a3fb-d0b1b7a3d595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:00.438600 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360af14-bba1-4403-a3fb-d0b1b7a3d595 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:00.438877 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360af14-bba1-4403-a3fb-d0b1b7a3d595 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:00.439157 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360af14-bba1-4403-a3fb-d0b1b7a3d595 None admin] PATH_INFO: `/v3/roles` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:00.439819 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f360af14-bba1-4403-a3fb-d0b1b7a3d595 None admin] RBAC: Adding query filter params (name=member) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:00.440120 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f360af14-bba1-4403-a3fb-d0b1b7a3d595 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:00.441556 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f360af14-bba1-4403-a3fb-d0b1b7a3d595 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:00.447301 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7092ab2d-5daf-46ea-8aac-fcdea5ea3fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:00.447923 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7092ab2d-5daf-46ea-8aac-fcdea5ea3fb2 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:00.448196 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7092ab2d-5daf-46ea-8aac-fcdea5ea3fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:00.448475 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7092ab2d-5daf-46ea-8aac-fcdea5ea3fb2 None admin] PATH_INFO: `/v3/users/bab2943cf3c54c859076f314da791ca1` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:00.451033 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 161/306] 10.222.0.70 () {56 vars in 1101 bytes} [Fri Aug 19 15:53:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:00.451846 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360af14-bba1-4403-a3fb-d0b1b7a3d595 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:00.462767 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7092ab2d-5daf-46ea-8aac-fcdea5ea3fb2 None admin] RBAC: Authorizing `identity:get_user(user_id=bab2943cf3c54c859076f314da791ca1)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:00.464487 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7092ab2d-5daf-46ea-8aac-fcdea5ea3fb2 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:00.470095 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 146/307] 10.222.0.70 () {56 vars in 1177 bytes} [Fri Aug 19 15:53:00 2022] GET /identity/v3/users/bab2943cf3c54c859076f314da791ca1 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:00.470095 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec9402-322b-43e3-8a57-3f5ee455eddb None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:00.470095 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec9402-322b-43e3-8a57-3f5ee455eddb None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:00.470095 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec9402-322b-43e3-8a57-3f5ee455eddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:00.486598 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-92ec9402-322b-43e3-8a57-3f5ee455eddb None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:53:00.487818 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-92ec9402-322b-43e3-8a57-3f5ee455eddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:53:00.488257 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:00.510405 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:00.560961 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 147/308] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:53:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:53:00.562330 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360af14-bba1-4403-a3fb-d0b1b7a3d595 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:00.570067 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ec9402-322b-43e3-8a57-3f5ee455eddb None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:00.596826 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcffb1e-0009-4f9d-b457-bf71faf4bede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:00.597438 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcffb1e-0009-4f9d-b457-bf71faf4bede None admin] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:00.597712 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcffb1e-0009-4f9d-b457-bf71faf4bede None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:00.597983 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcffb1e-0009-4f9d-b457-bf71faf4bede None admin] PATH_INFO: `/v3/groups` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:00.598595 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcffb1e-0009-4f9d-b457-bf71faf4bede None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:00.600110 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcffb1e-0009-4f9d-b457-bf71faf4bede None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:00.680875 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 162/309] 10.222.0.70 () {60 vars in 1134 bytes} [Fri Aug 19 15:53:00 2022] POST /identity/v3/groups => generated 229 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:53:00.682357 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcffb1e-0009-4f9d-b457-bf71faf4bede None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:00.683938 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ec9402-322b-43e3-8a57-3f5ee455eddb None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:00.739518 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1a3d8e-8483-4451-a693-cccaf638940e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:00.740211 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a3d8e-8483-4451-a693-cccaf638940e None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:00.740494 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a3d8e-8483-4451-a693-cccaf638940e None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:00.740803 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a3d8e-8483-4451-a693-cccaf638940e None admin] PATH_INFO: `/v3/users/3495c88025534cb4a23e4c64548db7dc` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:00.742084 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1a3d8e-8483-4451-a693-cccaf638940e None admin] RBAC: Authorizing `identity:get_user(user_id=3495c88025534cb4a23e4c64548db7dc)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:00.743690 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1a3d8e-8483-4451-a693-cccaf638940e None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:00.746649 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 148/310] 10.222.0.70 () {56 vars in 1177 bytes} [Fri Aug 19 15:53:00 2022] GET /identity/v3/users/3495c88025534cb4a23e4c64548db7dc => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:00.752713 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1a3d8e-8483-4451-a693-cccaf638940e None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:00.781739 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:00.824794 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:00.844881 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcffb1e-0009-4f9d-b457-bf71faf4bede None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:00.884700 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1a3d8e-8483-4451-a693-cccaf638940e None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:00.895770 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83110b35-a5f6-4d1f-a761-bf4a4526d345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:00.896801 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83110b35-a5f6-4d1f-a761-bf4a4526d345 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:00.897388 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83110b35-a5f6-4d1f-a761-bf4a4526d345 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:00.897911 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83110b35-a5f6-4d1f-a761-bf4a4526d345 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:00.898915 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83110b35-a5f6-4d1f-a761-bf4a4526d345 None admin] RBAC: Adding query filter params (role.id=2e3dded4c3734675b1978c6f9ec33c7b, user.id=bab2943cf3c54c859076f314da791ca1, scope.system=all) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:00.899647 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83110b35-a5f6-4d1f-a761-bf4a4526d345 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:00.902019 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83110b35-a5f6-4d1f-a761-bf4a4526d345 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:00.908791 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 163/311] 10.222.0.70 () {56 vars in 1308 bytes} [Fri Aug 19 15:53:00 2022] GET /identity/v3/role_assignments?user.id=bab2943cf3c54c859076f314da791ca1&scope.system=all&role.id=2e3dded4c3734675b1978c6f9ec33c7b => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:00.910338 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83110b35-a5f6-4d1f-a761-bf4a4526d345 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:00.934067 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef73e8-76d3-4e62-b935-ed95ef59f467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:00.934819 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef73e8-76d3-4e62-b935-ed95ef59f467 None admin] REQUEST_METHOD: `PUT` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:00.935016 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef73e8-76d3-4e62-b935-ed95ef59f467 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:00.935294 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef73e8-76d3-4e62-b935-ed95ef59f467 None admin] PATH_INFO: `/v3/system/users/3495c88025534cb4a23e4c64548db7dc/roles/09971bc698e84205be000073fc048af2` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:00.938441 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caef73e8-76d3-4e62-b935-ed95ef59f467 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3495c88025534cb4a23e4c64548db7dc, role_id=09971bc698e84205be000073fc048af2)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:00.938441 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caef73e8-76d3-4e62-b935-ed95ef59f467 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:01.037574 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83110b35-a5f6-4d1f-a761-bf4a4526d345 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:01.074774 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 149/312] 10.222.0.70 () {58 vars in 1334 bytes} [Fri Aug 19 15:53:00 2022] PUT /identity/v3/system/users/3495c88025534cb4a23e4c64548db7dc/roles/09971bc698e84205be000073fc048af2 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:53:01.082824 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8651e79-438e-4001-a359-91f7b738103d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:01.084001 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8651e79-438e-4001-a359-91f7b738103d None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:01.084528 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8651e79-438e-4001-a359-91f7b738103d None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:01.085035 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8651e79-438e-4001-a359-91f7b738103d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:01.099814 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8651e79-438e-4001-a359-91f7b738103d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:53:01.108089 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-a8651e79-438e-4001-a359-91f7b738103d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 15:53:01.108089 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:01.108089 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:01.108089 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:01.108089 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:01.108089 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:01.108089 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:01.108089 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:01.108089 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:01.108089 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:01.108089 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:01.108089 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:01.108089 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:53:01.108089 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:53:01.108089 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:53:01.108089 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:53:01.115820 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:53:01.115820 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:53:01.115820 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:53:01.115820 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:53:01.115820 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:01.115820 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:01.115820 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:01.115820 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:01.115820 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:01.115820 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:01.115820 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:01.115820 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:01.115820 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:01.115820 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:01.115820 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:01.115820 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:01.116654 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:01.116654 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:01.116654 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:01.116654 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:01.116654 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:53:01.116654 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:53:01.116654 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:53:01.116654 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:53:01.116654 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:53:01.116654 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:53:01.116654 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 15:53:01.116654 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:01.116654 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 164/313] 10.222.0.70 () {56 vars in 1099 bytes} [Fri Aug 19 15:53:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:01.119680 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef73e8-76d3-4e62-b935-ed95ef59f467 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:01.233484 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:01.251570 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef73e8-76d3-4e62-b935-ed95ef59f467 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:01.293408 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b6ecc4-fe00-4ce5-9f0b-0083d4df405e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:01.294330 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6ecc4-fe00-4ce5-9f0b-0083d4df405e None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:01.294605 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6ecc4-fe00-4ce5-9f0b-0083d4df405e None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:01.294873 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6ecc4-fe00-4ce5-9f0b-0083d4df405e None admin] PATH_INFO: `/v3/roles` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:01.295532 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b6ecc4-fe00-4ce5-9f0b-0083d4df405e None admin] RBAC: Adding query filter params (name=reader) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:01.295891 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b6ecc4-fe00-4ce5-9f0b-0083d4df405e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:01.297227 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b6ecc4-fe00-4ce5-9f0b-0083d4df405e None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:01.306538 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 150/314] 10.222.0.70 () {56 vars in 1101 bytes} [Fri Aug 19 15:53:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:01.313569 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8651e79-438e-4001-a359-91f7b738103d None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:01.334670 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:01.426397 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8651e79-438e-4001-a359-91f7b738103d None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:01.463415 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea852d69-44d5-40fd-b45b-622f002e18af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:01.464064 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea852d69-44d5-40fd-b45b-622f002e18af None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:01.464313 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea852d69-44d5-40fd-b45b-622f002e18af None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:01.464577 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea852d69-44d5-40fd-b45b-622f002e18af None admin] PATH_INFO: `/v3/users/e9540bff309943beb60171e6659eccf3` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:01.465772 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea852d69-44d5-40fd-b45b-622f002e18af None admin] RBAC: Authorizing `identity:get_user(user_id=e9540bff309943beb60171e6659eccf3)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:01.467216 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea852d69-44d5-40fd-b45b-622f002e18af None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:01.469201 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 165/315] 10.222.0.70 () {56 vars in 1177 bytes} [Fri Aug 19 15:53:01 2022] GET /identity/v3/users/e9540bff309943beb60171e6659eccf3 => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:01.474587 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b6ecc4-fe00-4ce5-9f0b-0083d4df405e None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:01.587017 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b6ecc4-fe00-4ce5-9f0b-0083d4df405e None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:01.626175 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36b0b6-9aeb-43ff-8c9f-279152495372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:01.627428 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36b0b6-9aeb-43ff-8c9f-279152495372 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:01.627908 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36b0b6-9aeb-43ff-8c9f-279152495372 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:01.628371 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36b0b6-9aeb-43ff-8c9f-279152495372 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:01.648001 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:01.703661 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e36b0b6-9aeb-43ff-8c9f-279152495372 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:01.705570 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e36b0b6-9aeb-43ff-8c9f-279152495372 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:01.816889 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 151/316] 10.222.0.70 () {58 vars in 1282 bytes} [Fri Aug 19 15:53:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:53:01.823718 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea852d69-44d5-40fd-b45b-622f002e18af None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:01.929320 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:01.952365 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea852d69-44d5-40fd-b45b-622f002e18af None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:01.989673 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b71f86f-f44e-4ab6-a556-3d03da95625b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:01.990311 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71f86f-f44e-4ab6-a556-3d03da95625b None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:01.990587 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71f86f-f44e-4ab6-a556-3d03da95625b None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:01.990878 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71f86f-f44e-4ab6-a556-3d03da95625b None admin] PATH_INFO: `/v3/projects/8299174a2d574620a12d3d2e42f01c55` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:01.992091 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b71f86f-f44e-4ab6-a556-3d03da95625b None admin] RBAC: Authorizing `identity:get_project(project_id=8299174a2d574620a12d3d2e42f01c55)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:01.994217 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b71f86f-f44e-4ab6-a556-3d03da95625b None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:01.995935 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 166/317] 10.222.0.70 () {56 vars in 1186 bytes} [Fri Aug 19 15:53:01 2022] GET /identity/v3/projects/8299174a2d574620a12d3d2e42f01c55 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:53:02.001878 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36b0b6-9aeb-43ff-8c9f-279152495372 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:02.056000 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:02.113462 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36b0b6-9aeb-43ff-8c9f-279152495372 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:02.151751 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e4c4b-d99e-4f56-b3e4-0953bea8deba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:02.152361 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e4c4b-d99e-4f56-b3e4-0953bea8deba None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:02.152646 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e4c4b-d99e-4f56-b3e4-0953bea8deba None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:02.152977 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e4c4b-d99e-4f56-b3e4-0953bea8deba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:02.153708 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e4c4b-d99e-4f56-b3e4-0953bea8deba None admin] RBAC: Adding query filter params (role.id=2e3dded4c3734675b1978c6f9ec33c7b, scope.project.id=8299174a2d574620a12d3d2e42f01c55, user.id=e9540bff309943beb60171e6659eccf3) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:02.154015 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e4c4b-d99e-4f56-b3e4-0953bea8deba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:02.155482 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e4c4b-d99e-4f56-b3e4-0953bea8deba None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:02.161876 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 152/318] 10.222.0.70 () {56 vars in 1374 bytes} [Fri Aug 19 15:53:02 2022] GET /identity/v3/role_assignments?user.id=e9540bff309943beb60171e6659eccf3&scope.project.id=8299174a2d574620a12d3d2e42f01c55&role.id=2e3dded4c3734675b1978c6f9ec33c7b => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:03.001249 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8388a8-2593-4938-9885-372fc1e4fc85 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:03.001795 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8388a8-2593-4938-9885-372fc1e4fc85 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:03.001795 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8388a8-2593-4938-9885-372fc1e4fc85 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:03.003613 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 167/319] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:53:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:53:03.009913 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4cb43-41fa-4fba-a46e-170b35bfbcfe None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:03.010665 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4cb43-41fa-4fba-a46e-170b35bfbcfe None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:03.010665 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4cb43-41fa-4fba-a46e-170b35bfbcfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:03.030222 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-1dd4cb43-41fa-4fba-a46e-170b35bfbcfe None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:53:03.031436 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-1dd4cb43-41fa-4fba-a46e-170b35bfbcfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:53:03.103783 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 153/320] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:53:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:53:03.167298 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972de41-1e45-4762-9d92-38386cb8b51f None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:03.167691 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972de41-1e45-4762-9d92-38386cb8b51f None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:03.168145 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972de41-1e45-4762-9d92-38386cb8b51f None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:03.169648 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 168/321] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:53:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:53:03.175037 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283fd5c1-7e74-46de-888f-5c9b7c76855d None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:03.175320 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283fd5c1-7e74-46de-888f-5c9b7c76855d None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:03.175593 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283fd5c1-7e74-46de-888f-5c9b7c76855d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:03.196641 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-283fd5c1-7e74-46de-888f-5c9b7c76855d None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:53:03.198556 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-283fd5c1-7e74-46de-888f-5c9b7c76855d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:53:03.235986 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:03.269103 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 154/322] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:53:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:53:03.433104 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5972de41-1e45-4762-9d92-38386cb8b51f None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:03.487453 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806de0c-b3b7-447b-9b55-4a085d1ceb1f None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:03.487724 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806de0c-b3b7-447b-9b55-4a085d1ceb1f None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:03.488193 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806de0c-b3b7-447b-9b55-4a085d1ceb1f None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:03.489546 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 155/323] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:53:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 15:53:03.495008 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30936e76-97f2-492b-a1b1-490fcf720bb9 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:03.495308 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30936e76-97f2-492b-a1b1-490fcf720bb9 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:03.495568 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30936e76-97f2-492b-a1b1-490fcf720bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:03.515205 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-30936e76-97f2-492b-a1b1-490fcf720bb9 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:53:03.516193 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-30936e76-97f2-492b-a1b1-490fcf720bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:53:03.589813 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5972de41-1e45-4762-9d92-38386cb8b51f None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:03.596540 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 156/324] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:53:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 15:53:03.597478 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30936e76-97f2-492b-a1b1-490fcf720bb9 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:03.632592 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba4903-0075-4f3f-8137-e04a3e40dde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:03.633307 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba4903-0075-4f3f-8137-e04a3e40dde0 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:03.633507 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba4903-0075-4f3f-8137-e04a3e40dde0 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:03.633771 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba4903-0075-4f3f-8137-e04a3e40dde0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:03.635337 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ba4903-0075-4f3f-8137-e04a3e40dde0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:03.636818 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ba4903-0075-4f3f-8137-e04a3e40dde0 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:03.638650 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 169/325] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:53:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:03.643951 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba4903-0075-4f3f-8137-e04a3e40dde0 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:03.666639 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:03.723831 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30936e76-97f2-492b-a1b1-490fcf720bb9 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:03.725391 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:03.762266 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba4903-0075-4f3f-8137-e04a3e40dde0 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:03.763408 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f121f-58d6-4f5e-a1ee-4137e05059f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:03.765108 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f121f-58d6-4f5e-a1ee-4137e05059f8 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:03.765108 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f121f-58d6-4f5e-a1ee-4137e05059f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:03.765312 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f121f-58d6-4f5e-a1ee-4137e05059f8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:03.776925 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7f121f-58d6-4f5e-a1ee-4137e05059f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:53:03.781694 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-be7f121f-58d6-4f5e-a1ee-4137e05059f8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 15:53:03.781694 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:03.781694 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:03.781694 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:03.781694 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:03.781694 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:03.781694 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:03.781694 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:03.781694 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:03.781694 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:03.781694 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:03.781694 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:03.781694 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:53:03.781694 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:53:03.781694 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:53:03.781694 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:53:03.783371 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:53:03.783371 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:53:03.783371 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:53:03.783371 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:53:03.783371 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:03.783371 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:03.783371 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:03.783371 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:03.783371 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:03.783371 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:03.783371 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:03.783371 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:03.783371 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:03.783371 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:03.783371 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:03.783371 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:03.784775 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:03.784775 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:03.784775 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:03.784775 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:03.784775 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:53:03.784775 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:53:03.784775 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:53:03.784775 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:53:03.784775 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:53:03.784775 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:53:03.784775 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 15:53:03.784775 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:53:03.784775 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 157/326] 10.222.0.70 () {56 vars in 1099 bytes} [Fri Aug 19 15:53:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:03.789489 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f121f-58d6-4f5e-a1ee-4137e05059f8 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:03.810660 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0859e188-1257-43d0-ab4b-64b0e388c9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:03.811289 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0859e188-1257-43d0-ab4b-64b0e388c9f5 None admin] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:03.811569 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0859e188-1257-43d0-ab4b-64b0e388c9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:03.811833 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0859e188-1257-43d0-ab4b-64b0e388c9f5 None admin] PATH_INFO: `/v3/groups` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:03.812443 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0859e188-1257-43d0-ab4b-64b0e388c9f5 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:03.813902 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0859e188-1257-43d0-ab4b-64b0e388c9f5 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:03.900204 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f121f-58d6-4f5e-a1ee-4137e05059f8 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:03.911766 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 170/327] 10.222.0.70 () {60 vars in 1134 bytes} [Fri Aug 19 15:53:03 2022] POST /identity/v3/groups => generated 226 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:53:03.929520 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0859e188-1257-43d0-ab4b-64b0e388c9f5 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:03.940024 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f007c675-59d4-4a5b-b636-dd878910a389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:03.940776 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f007c675-59d4-4a5b-b636-dd878910a389 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:03.941058 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f007c675-59d4-4a5b-b636-dd878910a389 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:03.941329 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f007c675-59d4-4a5b-b636-dd878910a389 None admin] PATH_INFO: `/v3/roles` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:03.942028 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f007c675-59d4-4a5b-b636-dd878910a389 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:03.942333 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f007c675-59d4-4a5b-b636-dd878910a389 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:03.943762 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f007c675-59d4-4a5b-b636-dd878910a389 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:03.958652 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 158/328] 10.222.0.70 () {56 vars in 1101 bytes} [Fri Aug 19 15:53:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:53:03.960349 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f007c675-59d4-4a5b-b636-dd878910a389 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:04.005089 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:04.042338 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:04.068868 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0859e188-1257-43d0-ab4b-64b0e388c9f5 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:04.095116 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f007c675-59d4-4a5b-b636-dd878910a389 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:04.112555 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee7c28-2a2b-4a7c-8852-d0b2afb0633b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:04.113298 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee7c28-2a2b-4a7c-8852-d0b2afb0633b None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:04.113550 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee7c28-2a2b-4a7c-8852-d0b2afb0633b None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:04.113825 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee7c28-2a2b-4a7c-8852-d0b2afb0633b None admin] PATH_INFO: `/v3/roles/member` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:04.128043 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ee7c28-2a2b-4a7c-8852-d0b2afb0633b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:53:04.133436 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-18ee7c28-2a2b-4a7c-8852-d0b2afb0633b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:53:04.133436 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:04.133436 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:04.133436 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:04.133436 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:04.133436 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:04.133436 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:04.133436 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:04.133436 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:04.133436 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:04.133436 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:04.133436 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:04.133436 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:53:04.133436 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:53:04.133436 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:53:04.133436 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:53:04.134552 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:53:04.134552 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:53:04.134552 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:53:04.134552 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:53:04.134552 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:04.134552 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:04.134552 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:04.134552 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:04.134552 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:04.134552 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:04.134552 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:04.134552 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:04.134552 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:04.134552 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:04.134552 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:04.134552 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:04.135367 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:04.135367 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:04.135367 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:04.135367 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:04.135367 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:53:04.135367 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:53:04.135367 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:53:04.135367 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:53:04.135367 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:53:04.135367 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:53:04.135367 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:53:04.135367 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:04.135367 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 171/329] 10.222.0.70 () {56 vars in 1099 bytes} [Fri Aug 19 15:53:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:53:04.137961 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e4e395-c7cd-4e37-ad10-cb2b420a1e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:04.138766 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e4e395-c7cd-4e37-ad10-cb2b420a1e89 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:04.139045 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e4e395-c7cd-4e37-ad10-cb2b420a1e89 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:04.139315 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e4e395-c7cd-4e37-ad10-cb2b420a1e89 None admin] PATH_INFO: `/v3/users/bab2943cf3c54c859076f314da791ca1` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:04.140480 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e4e395-c7cd-4e37-ad10-cb2b420a1e89 None admin] RBAC: Authorizing `identity:get_user(user_id=bab2943cf3c54c859076f314da791ca1)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:04.141158 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee7c28-2a2b-4a7c-8852-d0b2afb0633b None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:04.141954 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e4e395-c7cd-4e37-ad10-cb2b420a1e89 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:04.143574 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 159/330] 10.222.0.70 () {56 vars in 1177 bytes} [Fri Aug 19 15:53:03 2022] GET /identity/v3/users/bab2943cf3c54c859076f314da791ca1 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:53:04.149179 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e4e395-c7cd-4e37-ad10-cb2b420a1e89 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:04.274071 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:04.285833 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e4e395-c7cd-4e37-ad10-cb2b420a1e89 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:04.290410 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee7c28-2a2b-4a7c-8852-d0b2afb0633b None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:04.332036 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca2e46-12c8-43c5-a780-f64ee65416e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:04.332823 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca2e46-12c8-43c5-a780-f64ee65416e2 None admin] REQUEST_METHOD: `PUT` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:04.333100 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca2e46-12c8-43c5-a780-f64ee65416e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:04.333372 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca2e46-12c8-43c5-a780-f64ee65416e2 None admin] PATH_INFO: `/v3/system/users/bab2943cf3c54c859076f314da791ca1/roles/2e3dded4c3734675b1978c6f9ec33c7b` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:04.335271 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cca2e46-12c8-43c5-a780-f64ee65416e2 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=bab2943cf3c54c859076f314da791ca1, role_id=2e3dded4c3734675b1978c6f9ec33c7b)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:04.337095 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cca2e46-12c8-43c5-a780-f64ee65416e2 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:04.338859 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dff393-5bca-40ee-8329-4f257e7c72e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:04.339749 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dff393-5bca-40ee-8329-4f257e7c72e8 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:04.340110 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dff393-5bca-40ee-8329-4f257e7c72e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:04.340456 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dff393-5bca-40ee-8329-4f257e7c72e8 None admin] PATH_INFO: `/v3/roles` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:04.341348 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dff393-5bca-40ee-8329-4f257e7c72e8 None admin] RBAC: Adding query filter params (name=member) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:04.348840 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dff393-5bca-40ee-8329-4f257e7c72e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:04.348840 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dff393-5bca-40ee-8329-4f257e7c72e8 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:04.351847 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:04.354714 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 172/331] 10.222.0.70 () {56 vars in 1101 bytes} [Fri Aug 19 15:53:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:53:04.360263 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dff393-5bca-40ee-8329-4f257e7c72e8 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:04.460435 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 160/332] 10.222.0.70 () {58 vars in 1334 bytes} [Fri Aug 19 15:53:04 2022] PUT /identity/v3/system/users/bab2943cf3c54c859076f314da791ca1/roles/2e3dded4c3734675b1978c6f9ec33c7b => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:53:04.474908 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dff393-5bca-40ee-8329-4f257e7c72e8 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:04.518563 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1222f819-9747-4070-8ae6-e09a5fedb3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:04.519336 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222f819-9747-4070-8ae6-e09a5fedb3f0 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:04.519606 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222f819-9747-4070-8ae6-e09a5fedb3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:04.519912 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222f819-9747-4070-8ae6-e09a5fedb3f0 None admin] PATH_INFO: `/v3/users/3495c88025534cb4a23e4c64548db7dc` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:04.521146 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1222f819-9747-4070-8ae6-e09a5fedb3f0 None admin] RBAC: Authorizing `identity:get_user(user_id=3495c88025534cb4a23e4c64548db7dc)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:04.522671 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1222f819-9747-4070-8ae6-e09a5fedb3f0 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:04.524744 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 173/333] 10.222.0.70 () {56 vars in 1177 bytes} [Fri Aug 19 15:53:04 2022] GET /identity/v3/users/3495c88025534cb4a23e4c64548db7dc => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:04.530639 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca2e46-12c8-43c5-a780-f64ee65416e2 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:04.683154 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca2e46-12c8-43c5-a780-f64ee65416e2 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:04.720497 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd3a3b-fafb-490a-a80a-9b3f874e26d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:04.721526 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd3a3b-fafb-490a-a80a-9b3f874e26d3 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:04.721803 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd3a3b-fafb-490a-a80a-9b3f874e26d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:04.722068 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd3a3b-fafb-490a-a80a-9b3f874e26d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:04.722840 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdd3a3b-fafb-490a-a80a-9b3f874e26d3 None admin] RBAC: Adding query filter params (role.id=09971bc698e84205be000073fc048af2, user.id=3495c88025534cb4a23e4c64548db7dc, scope.system=all) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:04.723141 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdd3a3b-fafb-490a-a80a-9b3f874e26d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:04.724874 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdd3a3b-fafb-490a-a80a-9b3f874e26d3 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:04.741998 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 161/334] 10.222.0.70 () {56 vars in 1308 bytes} [Fri Aug 19 15:53:04 2022] GET /identity/v3/role_assignments?user.id=3495c88025534cb4a23e4c64548db7dc&scope.system=all&role.id=09971bc698e84205be000073fc048af2 => generated 510 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:06.519220 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c40e1-0fbf-4148-9975-da9893ac1a4b None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:06.519760 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c40e1-0fbf-4148-9975-da9893ac1a4b None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:06.519894 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c40e1-0fbf-4148-9975-da9893ac1a4b None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:06.521478 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 174/335] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:53:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:53:06.527644 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa992136-7587-4e70-8484-2e0cfbd983e0 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:06.528484 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa992136-7587-4e70-8484-2e0cfbd983e0 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:06.529038 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa992136-7587-4e70-8484-2e0cfbd983e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:06.552722 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-aa992136-7587-4e70-8484-2e0cfbd983e0 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:53:06.554240 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-aa992136-7587-4e70-8484-2e0cfbd983e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:53:06.569627 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:06.641119 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 162/336] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:53:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:53:06.982952 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71735795-ff38-4e3a-b663-b515a30fdc83 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:06.983652 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71735795-ff38-4e3a-b663-b515a30fdc83 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:06.984129 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71735795-ff38-4e3a-b663-b515a30fdc83 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:06.985963 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 175/337] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:53:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:53:06.991844 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1bddc-ca54-4431-8d6c-5b171ee758b6 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:06.992387 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1bddc-ca54-4431-8d6c-5b171ee758b6 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:06.992908 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1bddc-ca54-4431-8d6c-5b171ee758b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:07.014446 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-08c1bddc-ca54-4431-8d6c-5b171ee758b6 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:53:07.015980 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-08c1bddc-ca54-4431-8d6c-5b171ee758b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:53:07.098968 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 163/338] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:53:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 15:53:07.363172 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71735795-ff38-4e3a-b663-b515a30fdc83 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:07.467288 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:07.511467 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71735795-ff38-4e3a-b663-b515a30fdc83 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:07.558708 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345191ac-3aa8-4c28-984e-26ad46c26d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:07.559461 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345191ac-3aa8-4c28-984e-26ad46c26d3d None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:07.559653 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345191ac-3aa8-4c28-984e-26ad46c26d3d None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:07.559882 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345191ac-3aa8-4c28-984e-26ad46c26d3d None admin] PATH_INFO: `/v3/roles/member` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:07.576647 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345191ac-3aa8-4c28-984e-26ad46c26d3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:53:07.582145 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-345191ac-3aa8-4c28-984e-26ad46c26d3d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:53:07.582145 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:07.582145 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:07.582145 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:07.582145 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:07.582145 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:07.582145 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:07.582145 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:07.582145 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:07.582145 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:07.582145 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:07.582145 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:07.582145 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:53:07.582145 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:53:07.582145 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:53:07.582145 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:53:07.583039 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:53:07.583039 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:53:07.583039 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:53:07.583039 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:53:07.583039 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:07.583039 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:07.583039 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:07.583039 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:07.583039 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:07.583039 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:07.583039 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:07.583039 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:07.583039 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:07.583039 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:07.583039 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:07.583039 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:07.583813 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:07.583813 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:07.583813 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:07.583813 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:07.583813 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:53:07.583813 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:53:07.583813 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:53:07.583813 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:53:07.583813 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:53:07.583813 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:53:07.583813 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:53:07.583813 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:07.583813 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 176/339] 10.222.0.70 () {56 vars in 1099 bytes} [Fri Aug 19 15:53:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:07.590035 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c1bddc-ca54-4431-8d6c-5b171ee758b6 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:07.599710 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345191ac-3aa8-4c28-984e-26ad46c26d3d None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:07.755339 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:07.795997 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345191ac-3aa8-4c28-984e-26ad46c26d3d None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:07.819790 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c1bddc-ca54-4431-8d6c-5b171ee758b6 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:07.830963 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:07.847487 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d407070e-e6ef-470f-837d-df5e542d8af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:07.848152 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407070e-e6ef-470f-837d-df5e542d8af9 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:07.848434 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407070e-e6ef-470f-837d-df5e542d8af9 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:07.848733 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407070e-e6ef-470f-837d-df5e542d8af9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:07.874578 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d407070e-e6ef-470f-837d-df5e542d8af9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:53:07.887770 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-d407070e-e6ef-470f-837d-df5e542d8af9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 15:53:07.887770 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:07.887770 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:07.887770 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:07.887770 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:07.887770 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:07.887770 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:07.887770 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:07.887770 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:07.887770 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:07.887770 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:07.887770 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:07.887770 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:53:07.887770 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:53:07.887770 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:53:07.887770 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:53:07.888782 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:53:07.888782 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:53:07.888782 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:53:07.888782 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:53:07.888782 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:07.888782 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:07.888782 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:07.888782 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:07.888782 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:07.888782 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:07.888782 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:07.888782 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:07.888782 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:07.888782 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:07.888782 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:07.888782 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:07.890152 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:07.890152 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:07.890152 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:07.890152 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:07.890152 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:53:07.890152 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:53:07.890152 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:53:07.890152 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:53:07.890152 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:53:07.890152 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:53:07.890152 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 15:53:07.890152 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:07.890152 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 177/340] 10.222.0.70 () {56 vars in 1114 bytes} [Fri Aug 19 15:53:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:07.891026 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b724d5-3137-47f2-8808-7b40d65de30d None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:07.891185 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b724d5-3137-47f2-8808-7b40d65de30d None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:07.891430 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b724d5-3137-47f2-8808-7b40d65de30d None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:07.893846 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 178/341] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:53:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:53:07.900746 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b724d5-3137-47f2-8808-7b40d65de30d None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:07.903149 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c980a29f-2406-44c1-8477-d17520b1f6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:07.903778 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980a29f-2406-44c1-8477-d17520b1f6a9 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:07.904121 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980a29f-2406-44c1-8477-d17520b1f6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:07.904398 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980a29f-2406-44c1-8477-d17520b1f6a9 None admin] PATH_INFO: `/v3/roles` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:07.905212 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c980a29f-2406-44c1-8477-d17520b1f6a9 None admin] RBAC: Adding query filter params (name=member) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:07.905518 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c980a29f-2406-44c1-8477-d17520b1f6a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:07.906965 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c980a29f-2406-44c1-8477-d17520b1f6a9 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:07.933538 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 164/342] 10.222.0.70 () {56 vars in 1101 bytes} [Fri Aug 19 15:53:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:07.934984 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c12cf9-247e-48a2-8bf2-994f1aaf8f34 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:07.935268 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c12cf9-247e-48a2-8bf2-994f1aaf8f34 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:07.935540 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c12cf9-247e-48a2-8bf2-994f1aaf8f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:07.972941 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-63c12cf9-247e-48a2-8bf2-994f1aaf8f34 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:53:07.974146 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-63c12cf9-247e-48a2-8bf2-994f1aaf8f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:53:08.083228 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b724d5-3137-47f2-8808-7b40d65de30d None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:08.099301 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 165/343] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:53:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:53:08.100548 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c12cf9-247e-48a2-8bf2-994f1aaf8f34 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:08.147954 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59380a57-2b9a-42c6-81ca-ede6646a5a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:08.148603 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59380a57-2b9a-42c6-81ca-ede6646a5a1a None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:08.148949 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59380a57-2b9a-42c6-81ca-ede6646a5a1a None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:08.149321 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59380a57-2b9a-42c6-81ca-ede6646a5a1a None admin] PATH_INFO: `/v3/roles` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:08.150884 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59380a57-2b9a-42c6-81ca-ede6646a5a1a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:08.151417 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59380a57-2b9a-42c6-81ca-ede6646a5a1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:08.152838 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59380a57-2b9a-42c6-81ca-ede6646a5a1a None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:08.168921 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 179/344] 10.222.0.70 () {56 vars in 1111 bytes} [Fri Aug 19 15:53:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:08.169977 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7ebb0-0e8f-4296-adda-fbbbf0bb0d26 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:08.170253 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7ebb0-0e8f-4296-adda-fbbbf0bb0d26 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:08.170521 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7ebb0-0e8f-4296-adda-fbbbf0bb0d26 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:08.171688 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 180/345] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:53:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:53:08.179907 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d7ebb0-0e8f-4296-adda-fbbbf0bb0d26 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:08.240907 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:08.295596 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:08.304960 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c12cf9-247e-48a2-8bf2-994f1aaf8f34 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:08.384148 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ac38e9-f9c4-4552-a87a-11359ab7c71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:08.385424 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ac38e9-f9c4-4552-a87a-11359ab7c71d None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:08.385702 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ac38e9-f9c4-4552-a87a-11359ab7c71d None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:08.385971 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ac38e9-f9c4-4552-a87a-11359ab7c71d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:08.410690 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d7ebb0-0e8f-4296-adda-fbbbf0bb0d26 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:08.473664 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a765a-69df-4517-b2c1-ba8307a2b5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:08.474388 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a765a-69df-4517-b2c1-ba8307a2b5c7 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:08.474760 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a765a-69df-4517-b2c1-ba8307a2b5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:08.475037 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a765a-69df-4517-b2c1-ba8307a2b5c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:08.516826 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ac38e9-f9c4-4552-a87a-11359ab7c71d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:08.519035 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ac38e9-f9c4-4552-a87a-11359ab7c71d None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:08.580775 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94a765a-69df-4517-b2c1-ba8307a2b5c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:08.583068 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94a765a-69df-4517-b2c1-ba8307a2b5c7 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:08.615704 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:08.655577 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:08.675019 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 166/346] 10.222.0.70 () {58 vars in 1282 bytes} [Fri Aug 19 15:53:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:53:08.676421 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b33eb9-eaf7-4236-b530-47ce6d5479e7 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:08.676743 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b33eb9-eaf7-4236-b530-47ce6d5479e7 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:08.677024 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b33eb9-eaf7-4236-b530-47ce6d5479e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:08.707070 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-e2b33eb9-eaf7-4236-b530-47ce6d5479e7 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:53:08.709732 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-e2b33eb9-eaf7-4236-b530-47ce6d5479e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:53:08.751422 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 181/347] 10.222.0.70 () {58 vars in 1282 bytes} [Fri Aug 19 15:53:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:53:08.753372 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff928b30-0cae-4450-83e1-f305463f6de8 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:08.753868 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff928b30-0cae-4450-83e1-f305463f6de8 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:08.754335 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff928b30-0cae-4450-83e1-f305463f6de8 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:08.755991 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 182/348] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:53:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:53:08.756979 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff928b30-0cae-4450-83e1-f305463f6de8 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:08.804510 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 167/349] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:53:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:53:08.805466 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b33eb9-eaf7-4236-b530-47ce6d5479e7 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:08.920816 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff928b30-0cae-4450-83e1-f305463f6de8 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:08.955006 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:08.960560 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8475ec18-b38e-47d5-b64e-f09d80fa1020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:08.964085 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475ec18-b38e-47d5-b64e-f09d80fa1020 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:08.964085 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475ec18-b38e-47d5-b64e-f09d80fa1020 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:08.964085 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475ec18-b38e-47d5-b64e-f09d80fa1020 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:08.964331 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b33eb9-eaf7-4236-b530-47ce6d5479e7 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:08.976022 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8475ec18-b38e-47d5-b64e-f09d80fa1020 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:53:08.981573 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-8475ec18-b38e-47d5-b64e-f09d80fa1020 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 15:53:08.981573 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:08.981573 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:08.981573 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:08.981573 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:08.981573 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:08.981573 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:08.981573 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:08.981573 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:08.981573 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:08.981573 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:08.981573 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:08.981573 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:53:08.981573 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:53:08.981573 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:53:08.981573 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:53:08.983073 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:53:08.983073 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:53:08.983073 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:53:08.983073 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:53:08.983073 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:08.983073 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:08.983073 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:08.983073 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:08.983073 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:08.983073 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:08.983073 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:08.983073 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:08.983073 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:08.983073 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:08.983073 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:08.983073 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:08.984482 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:08.984482 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:08.984482 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:08.984482 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:08.984482 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:53:08.984482 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:53:08.984482 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:53:08.984482 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:53:08.984482 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:53:08.984482 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:53:08.984482 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 15:53:08.984482 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:08.984482 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 183/350] 10.222.0.70 () {56 vars in 1099 bytes} [Fri Aug 19 15:53:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:08.984482 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba35ed1-b0c7-4072-84ee-e64a27baa4fe None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:08.986328 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba35ed1-b0c7-4072-84ee-e64a27baa4fe None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:08.986328 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba35ed1-b0c7-4072-84ee-e64a27baa4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:09.006809 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-5ba35ed1-b0c7-4072-84ee-e64a27baa4fe None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:53:09.007116 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f292e-0c47-404d-8d28-87d573c93db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:09.007497 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f292e-0c47-404d-8d28-87d573c93db8 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:09.007781 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f292e-0c47-404d-8d28-87d573c93db8 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:09.008033 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f292e-0c47-404d-8d28-87d573c93db8 None admin] PATH_INFO: `/v3/projects/2e809a1a094b48538c004035badbc88e` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:09.008277 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-5ba35ed1-b0c7-4072-84ee-e64a27baa4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:53:09.010913 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7f292e-0c47-404d-8d28-87d573c93db8 None admin] RBAC: Authorizing `identity:get_project(project_id=2e809a1a094b48538c004035badbc88e)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:09.011491 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:09.012364 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7f292e-0c47-404d-8d28-87d573c93db8 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:09.014094 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 168/351] 10.222.0.70 () {56 vars in 1186 bytes} [Fri Aug 19 15:53:08 2022] GET /identity/v3/projects/2e809a1a094b48538c004035badbc88e => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:09.014953 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f292e-0c47-404d-8d28-87d573c93db8 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:09.104788 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 184/352] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:53:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:53:09.105782 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba35ed1-b0c7-4072-84ee-e64a27baa4fe None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:09.212856 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f292e-0c47-404d-8d28-87d573c93db8 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:09.270372 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c2bf2-aa17-4fbb-a8ea-0a5daee3f927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:09.271097 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c2bf2-aa17-4fbb-a8ea-0a5daee3f927 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:09.271377 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c2bf2-aa17-4fbb-a8ea-0a5daee3f927 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:09.271822 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c2bf2-aa17-4fbb-a8ea-0a5daee3f927 None admin] PATH_INFO: `/v3/projects/2e809a1a094b48538c004035badbc88e` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:09.273529 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99c2bf2-aa17-4fbb-a8ea-0a5daee3f927 None admin] RBAC: Authorizing `identity:get_project(project_id=2e809a1a094b48538c004035badbc88e)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:09.275079 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99c2bf2-aa17-4fbb-a8ea-0a5daee3f927 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:09.278350 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 169/353] 10.222.0.70 () {56 vars in 1186 bytes} [Fri Aug 19 15:53:09 2022] GET /identity/v3/projects/2e809a1a094b48538c004035badbc88e => generated 298 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:09.281528 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c2bf2-aa17-4fbb-a8ea-0a5daee3f927 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:09.301344 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba35ed1-b0c7-4072-84ee-e64a27baa4fe None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:09.327215 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:09.342443 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea351a0-e866-4ac8-b934-bf1ec32215c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:09.343398 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea351a0-e866-4ac8-b934-bf1ec32215c2 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:09.343922 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea351a0-e866-4ac8-b934-bf1ec32215c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:09.344417 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea351a0-e866-4ac8-b934-bf1ec32215c2 None admin] PATH_INFO: `/v3/roles` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:09.345349 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea351a0-e866-4ac8-b934-bf1ec32215c2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:09.345891 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea351a0-e866-4ac8-b934-bf1ec32215c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:09.347504 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea351a0-e866-4ac8-b934-bf1ec32215c2 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:09.358435 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 185/354] 10.222.0.70 () {56 vars in 1101 bytes} [Fri Aug 19 15:53:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:09.359698 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea351a0-e866-4ac8-b934-bf1ec32215c2 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:09.372560 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:09.421418 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c2bf2-aa17-4fbb-a8ea-0a5daee3f927 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:09.468366 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e0446-56c5-4c35-858b-e65e3435ea42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:09.468960 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e0446-56c5-4c35-858b-e65e3435ea42 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:09.469240 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e0446-56c5-4c35-858b-e65e3435ea42 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:09.469608 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e0446-56c5-4c35-858b-e65e3435ea42 None admin] PATH_INFO: `/v3/groups/ee23f78826d64fc999d4841e3dbd61c6` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:09.479973 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e0446-56c5-4c35-858b-e65e3435ea42 None admin] RBAC: Authorizing `identity:get_group(group_id=ee23f78826d64fc999d4841e3dbd61c6)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:09.482127 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e0446-56c5-4c35-858b-e65e3435ea42 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:09.484412 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 170/355] 10.222.0.70 () {56 vars in 1180 bytes} [Fri Aug 19 15:53:09 2022] GET /identity/v3/groups/ee23f78826d64fc999d4841e3dbd61c6 => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:09.485063 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e0446-56c5-4c35-858b-e65e3435ea42 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:09.494202 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea351a0-e866-4ac8-b934-bf1ec32215c2 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:09.539158 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca2054-cd38-43c1-8823-0b7654e28e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:09.539790 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca2054-cd38-43c1-8823-0b7654e28e82 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:09.540062 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca2054-cd38-43c1-8823-0b7654e28e82 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:09.540854 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca2054-cd38-43c1-8823-0b7654e28e82 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:09.555624 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ca2054-cd38-43c1-8823-0b7654e28e82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:53:09.562899 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-d9ca2054-cd38-43c1-8823-0b7654e28e82 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:53:09.562899 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:09.562899 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:09.562899 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:09.562899 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:09.562899 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:09.562899 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:09.562899 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:09.562899 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:09.562899 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:09.562899 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:09.562899 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:09.562899 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:53:09.562899 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:53:09.562899 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:53:09.562899 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:53:09.563841 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:53:09.563841 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:53:09.563841 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:53:09.563841 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:53:09.563841 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:09.563841 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:09.563841 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:09.563841 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:09.563841 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:09.563841 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:09.563841 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:09.563841 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:09.563841 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:09.563841 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:09.563841 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:09.563841 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:09.564611 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:09.564611 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:09.564611 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:09.564611 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:09.564611 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:53:09.564611 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:53:09.564611 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:53:09.564611 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:53:09.564611 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:53:09.564611 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:53:09.564611 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:53:09.564611 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:09.564611 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 186/356] 10.222.0.70 () {56 vars in 1099 bytes} [Fri Aug 19 15:53:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:09.565350 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca2054-cd38-43c1-8823-0b7654e28e82 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:09.620622 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:09.628990 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e0446-56c5-4c35-858b-e65e3435ea42 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:09.647934 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:09.677139 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a166a5-bbf8-491d-b4c4-ca7fa43dd05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:09.677371 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a166a5-bbf8-491d-b4c4-ca7fa43dd05e None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:09.677642 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a166a5-bbf8-491d-b4c4-ca7fa43dd05e None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:09.677920 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a166a5-bbf8-491d-b4c4-ca7fa43dd05e None admin] PATH_INFO: `/v3/groups/ee23f78826d64fc999d4841e3dbd61c6` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:09.679349 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a166a5-bbf8-491d-b4c4-ca7fa43dd05e None admin] RBAC: Authorizing `identity:get_group(group_id=ee23f78826d64fc999d4841e3dbd61c6)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:09.681034 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a166a5-bbf8-491d-b4c4-ca7fa43dd05e None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:09.682887 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 171/357] 10.222.0.70 () {56 vars in 1180 bytes} [Fri Aug 19 15:53:09 2022] GET /identity/v3/groups/ee23f78826d64fc999d4841e3dbd61c6 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:09.685093 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85484a-c27b-45de-abf7-4348d35bf3ae None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:09.688154 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85484a-c27b-45de-abf7-4348d35bf3ae None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:09.688154 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85484a-c27b-45de-abf7-4348d35bf3ae None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:09.688154 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 172/358] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:53:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:53:09.688154 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b85484a-c27b-45de-abf7-4348d35bf3ae None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:09.710716 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca2054-cd38-43c1-8823-0b7654e28e82 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:09.757354 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7273dd-c449-4202-95c7-f7b67c3989ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:09.757912 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7273dd-c449-4202-95c7-f7b67c3989ce None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:09.758276 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7273dd-c449-4202-95c7-f7b67c3989ce None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:09.758563 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7273dd-c449-4202-95c7-f7b67c3989ce None admin] PATH_INFO: `/v3/users/bab2943cf3c54c859076f314da791ca1` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:09.759951 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7273dd-c449-4202-95c7-f7b67c3989ce None admin] RBAC: Authorizing `identity:get_user(user_id=bab2943cf3c54c859076f314da791ca1)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:09.761644 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7273dd-c449-4202-95c7-f7b67c3989ce None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:09.765436 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 187/359] 10.222.0.70 () {56 vars in 1177 bytes} [Fri Aug 19 15:53:09 2022] GET /identity/v3/users/bab2943cf3c54c859076f314da791ca1 => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:09.766134 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7273dd-c449-4202-95c7-f7b67c3989ce None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:09.826565 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b85484a-c27b-45de-abf7-4348d35bf3ae None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:09.870704 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa206ba3-8dec-460c-98ae-486af55e3c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:09.871445 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa206ba3-8dec-460c-98ae-486af55e3c7c None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:09.871785 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa206ba3-8dec-460c-98ae-486af55e3c7c None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:09.872126 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa206ba3-8dec-460c-98ae-486af55e3c7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:09.872985 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa206ba3-8dec-460c-98ae-486af55e3c7c None admin] RBAC: Adding query filter params (group.id=ee23f78826d64fc999d4841e3dbd61c6, role.id=09971bc698e84205be000073fc048af2, scope.project.id=2e809a1a094b48538c004035badbc88e) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:09.873305 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa206ba3-8dec-460c-98ae-486af55e3c7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:09.874747 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa206ba3-8dec-460c-98ae-486af55e3c7c None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:09.881439 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 173/360] 10.222.0.70 () {56 vars in 1376 bytes} [Fri Aug 19 15:53:09 2022] GET /identity/v3/role_assignments?group.id=ee23f78826d64fc999d4841e3dbd61c6&scope.project.id=2e809a1a094b48538c004035badbc88e&role.id=09971bc698e84205be000073fc048af2 => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:09.882295 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa206ba3-8dec-460c-98ae-486af55e3c7c None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:09.888203 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7273dd-c449-4202-95c7-f7b67c3989ce None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:09.932042 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:09.933997 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:09.942146 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d22f0-44e7-4030-976d-f4776f2d3d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:09.943177 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d22f0-44e7-4030-976d-f4776f2d3d7d None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:09.943682 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d22f0-44e7-4030-976d-f4776f2d3d7d None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:09.944178 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d22f0-44e7-4030-976d-f4776f2d3d7d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:09.964951 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444d22f0-44e7-4030-976d-f4776f2d3d7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:53:09.970180 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-444d22f0-44e7-4030-976d-f4776f2d3d7d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 15:53:09.970180 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:09.970180 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:09.970180 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:09.970180 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:09.970180 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:09.970180 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:09.970180 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:09.970180 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:09.970180 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:09.970180 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:09.970180 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:09.970180 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:53:09.970180 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:53:09.970180 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:53:09.970180 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:53:09.971884 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:53:09.971884 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:53:09.971884 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:53:09.971884 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:53:09.971884 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:09.971884 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:09.971884 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:09.971884 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:09.971884 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:09.971884 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:09.971884 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:09.971884 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:09.971884 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:09.971884 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:09.971884 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:09.971884 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:09.973293 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:09.973293 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:09.973293 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:09.973293 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:09.973293 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:53:09.973293 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:53:09.973293 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:53:09.973293 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:53:09.973293 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:53:09.973293 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:53:09.973293 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 15:53:09.973293 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:09.973293 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 188/361] 10.222.0.70 () {56 vars in 1114 bytes} [Fri Aug 19 15:53:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:09.973293 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d22f0-44e7-4030-976d-f4776f2d3d7d None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:10.050062 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa206ba3-8dec-460c-98ae-486af55e3c7c None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:10.102608 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d1c0c-38b6-462d-95c6-94b831849c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:10.103831 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d1c0c-38b6-462d-95c6-94b831849c3e None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:10.104106 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d1c0c-38b6-462d-95c6-94b831849c3e None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:10.104598 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d1c0c-38b6-462d-95c6-94b831849c3e None admin] PATH_INFO: `/v3/roles` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:10.108742 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d1c0c-38b6-462d-95c6-94b831849c3e None admin] RBAC: Adding query filter params (name=member) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:10.108742 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d1c0c-38b6-462d-95c6-94b831849c3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:10.108952 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d1c0c-38b6-462d-95c6-94b831849c3e None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:10.121065 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d22f0-44e7-4030-976d-f4776f2d3d7d None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:10.124300 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 174/362] 10.222.0.70 () {56 vars in 1101 bytes} [Fri Aug 19 15:53:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:10.125656 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc0455-4fe5-4f53-87e1-3167639ee0b0 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:10.125997 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc0455-4fe5-4f53-87e1-3167639ee0b0 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:10.126275 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc0455-4fe5-4f53-87e1-3167639ee0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:10.147793 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-7cdc0455-4fe5-4f53-87e1-3167639ee0b0 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:53:10.149028 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-7cdc0455-4fe5-4f53-87e1-3167639ee0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:53:10.164866 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc9eac-5168-406c-a379-4e200774945a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:10.166084 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc9eac-5168-406c-a379-4e200774945a None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:10.166446 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc9eac-5168-406c-a379-4e200774945a None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:10.166743 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc9eac-5168-406c-a379-4e200774945a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:10.167560 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fc9eac-5168-406c-a379-4e200774945a None admin] RBAC: Adding query filter params (group.id=ee23f78826d64fc999d4841e3dbd61c6, role.id=294bcd6132ef46d48aff3efa4d77fa0a, scope.project.id=2e809a1a094b48538c004035badbc88e) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:10.167863 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fc9eac-5168-406c-a379-4e200774945a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:10.169345 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fc9eac-5168-406c-a379-4e200774945a None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:10.175684 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 189/363] 10.222.0.70 () {56 vars in 1376 bytes} [Fri Aug 19 15:53:09 2022] GET /identity/v3/role_assignments?group.id=ee23f78826d64fc999d4841e3dbd61c6&scope.project.id=2e809a1a094b48538c004035badbc88e&role.id=294bcd6132ef46d48aff3efa4d77fa0a => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:10.176505 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc9eac-5168-406c-a379-4e200774945a None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:10.240605 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 175/364] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:53:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:53:10.241522 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc0455-4fe5-4f53-87e1-3167639ee0b0 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:10.249239 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:10.281057 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:10.351447 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc9eac-5168-406c-a379-4e200774945a None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:10.433653 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d6b4c-4137-4fae-8609-9a01c29d7718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:10.434268 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d6b4c-4137-4fae-8609-9a01c29d7718 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:10.434563 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d6b4c-4137-4fae-8609-9a01c29d7718 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:10.435005 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d6b4c-4137-4fae-8609-9a01c29d7718 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:10.436301 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84d6b4c-4137-4fae-8609-9a01c29d7718 None admin] RBAC: Adding query filter params (role.id=2e3dded4c3734675b1978c6f9ec33c7b, user.id=bab2943cf3c54c859076f314da791ca1, scope.system=all) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:10.436867 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84d6b4c-4137-4fae-8609-9a01c29d7718 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:10.438438 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84d6b4c-4137-4fae-8609-9a01c29d7718 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:10.459277 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc0455-4fe5-4f53-87e1-3167639ee0b0 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:10.461654 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 190/365] 10.222.0.70 () {56 vars in 1308 bytes} [Fri Aug 19 15:53:10 2022] GET /identity/v3/role_assignments?user.id=bab2943cf3c54c859076f314da791ca1&scope.system=all&role.id=2e3dded4c3734675b1978c6f9ec33c7b => generated 510 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:10.464181 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d6b4c-4137-4fae-8609-9a01c29d7718 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:10.512647 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324907f-b9a1-4edb-8872-21e8aff077a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:10.513312 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324907f-b9a1-4edb-8872-21e8aff077a2 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:10.513588 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324907f-b9a1-4edb-8872-21e8aff077a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:10.513850 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324907f-b9a1-4edb-8872-21e8aff077a2 None admin] PATH_INFO: `/v3/roles` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:10.514543 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b324907f-b9a1-4edb-8872-21e8aff077a2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:10.514844 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b324907f-b9a1-4edb-8872-21e8aff077a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:10.516265 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b324907f-b9a1-4edb-8872-21e8aff077a2 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:10.529607 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 176/366] 10.222.0.70 () {56 vars in 1111 bytes} [Fri Aug 19 15:53:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:10.535976 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324907f-b9a1-4edb-8872-21e8aff077a2 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:10.613142 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d6b4c-4137-4fae-8609-9a01c29d7718 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:10.626581 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:10.662878 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf847f7-c7ab-47fa-89bb-cfbd6e219360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:10.663847 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf847f7-c7ab-47fa-89bb-cfbd6e219360 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:10.663847 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf847f7-c7ab-47fa-89bb-cfbd6e219360 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:10.663847 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf847f7-c7ab-47fa-89bb-cfbd6e219360 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:10.671513 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:10.699712 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324907f-b9a1-4edb-8872-21e8aff077a2 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:10.753272 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e62abb-e97e-49a2-8ff7-40ed50de5c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:10.753903 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e62abb-e97e-49a2-8ff7-40ed50de5c15 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:10.754174 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e62abb-e97e-49a2-8ff7-40ed50de5c15 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:10.754440 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e62abb-e97e-49a2-8ff7-40ed50de5c15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:10.768246 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf847f7-c7ab-47fa-89bb-cfbd6e219360 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:10.769626 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf847f7-c7ab-47fa-89bb-cfbd6e219360 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:10.860035 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e62abb-e97e-49a2-8ff7-40ed50de5c15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:10.862252 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e62abb-e97e-49a2-8ff7-40ed50de5c15 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:10.918507 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 191/367] 10.222.0.70 () {58 vars in 1282 bytes} [Fri Aug 19 15:53:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:53:10.919397 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf847f7-c7ab-47fa-89bb-cfbd6e219360 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:10.933907 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:10.963731 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:10.984474 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 177/368] 10.222.0.70 () {58 vars in 1282 bytes} [Fri Aug 19 15:53:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:53:10.985653 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e62abb-e97e-49a2-8ff7-40ed50de5c15 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:11.070413 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf847f7-c7ab-47fa-89bb-cfbd6e219360 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:11.106305 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e62abb-e97e-49a2-8ff7-40ed50de5c15 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:11.120042 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6b1a8-e9d7-419c-a028-6704d1d62a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:11.121311 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6b1a8-e9d7-419c-a028-6704d1d62a15 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:11.121799 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6b1a8-e9d7-419c-a028-6704d1d62a15 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:11.122776 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6b1a8-e9d7-419c-a028-6704d1d62a15 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:11.138348 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb6b1a8-e9d7-419c-a028-6704d1d62a15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:53:11.143965 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-fcb6b1a8-e9d7-419c-a028-6704d1d62a15 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:53:11.143965 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:11.143965 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:11.143965 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:11.143965 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:11.143965 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:11.143965 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:11.143965 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:11.143965 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:11.143965 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:11.143965 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:11.143965 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:11.143965 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:53:11.143965 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:53:11.143965 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:53:11.143965 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:53:11.144891 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:53:11.144891 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:53:11.144891 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:53:11.144891 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:53:11.144891 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:11.144891 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:11.144891 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:11.144891 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:11.144891 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:11.144891 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:11.144891 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:11.144891 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:11.144891 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:11.144891 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:11.144891 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:11.144891 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:11.145695 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:11.145695 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:11.145695 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:11.145695 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:11.145695 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:53:11.145695 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:53:11.145695 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:53:11.145695 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:53:11.145695 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:53:11.145695 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:53:11.145695 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:53:11.145695 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:11.146294 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 192/369] 10.222.0.70 () {56 vars in 1096 bytes} [Fri Aug 19 15:53:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:11.147256 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6b1a8-e9d7-419c-a028-6704d1d62a15 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:11.178775 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a35ea-d60a-49d7-b2f3-598173dbc3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:11.180152 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a35ea-d60a-49d7-b2f3-598173dbc3b6 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:11.180647 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a35ea-d60a-49d7-b2f3-598173dbc3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:11.181207 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a35ea-d60a-49d7-b2f3-598173dbc3b6 None admin] PATH_INFO: `/v3/projects/8299174a2d574620a12d3d2e42f01c55` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:11.184072 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6a35ea-d60a-49d7-b2f3-598173dbc3b6 None admin] RBAC: Authorizing `identity:get_project(project_id=8299174a2d574620a12d3d2e42f01c55)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:11.187768 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6a35ea-d60a-49d7-b2f3-598173dbc3b6 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:11.192692 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 178/370] 10.222.0.70 () {56 vars in 1186 bytes} [Fri Aug 19 15:53:10 2022] GET /identity/v3/projects/8299174a2d574620a12d3d2e42f01c55 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:11.194194 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a35ea-d60a-49d7-b2f3-598173dbc3b6 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:11.252746 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:11.296761 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6b1a8-e9d7-419c-a028-6704d1d62a15 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:11.322725 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:11.362082 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae0c02-e4a0-43b2-b1f8-ebb521e858d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:11.364037 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae0c02-e4a0-43b2-b1f8-ebb521e858d3 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:11.364037 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae0c02-e4a0-43b2-b1f8-ebb521e858d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:11.364037 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae0c02-e4a0-43b2-b1f8-ebb521e858d3 None admin] PATH_INFO: `/v3/projects/8299174a2d574620a12d3d2e42f01c55` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:11.367585 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae0c02-e4a0-43b2-b1f8-ebb521e858d3 None admin] RBAC: Authorizing `identity:get_project(project_id=8299174a2d574620a12d3d2e42f01c55)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:11.370294 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae0c02-e4a0-43b2-b1f8-ebb521e858d3 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:11.374913 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 193/371] 10.222.0.70 () {56 vars in 1186 bytes} [Fri Aug 19 15:53:11 2022] GET /identity/v3/projects/8299174a2d574620a12d3d2e42f01c55 => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:11.376234 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae0c02-e4a0-43b2-b1f8-ebb521e858d3 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:11.423328 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a35ea-d60a-49d7-b2f3-598173dbc3b6 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:11.472991 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afe1414-6c0a-4f4b-bd4c-940de18284f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:11.473924 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe1414-6c0a-4f4b-bd4c-940de18284f7 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:11.474545 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe1414-6c0a-4f4b-bd4c-940de18284f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:11.474994 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe1414-6c0a-4f4b-bd4c-940de18284f7 None admin] PATH_INFO: `/v3/roles` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:11.475864 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afe1414-6c0a-4f4b-bd4c-940de18284f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:11.476469 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afe1414-6c0a-4f4b-bd4c-940de18284f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:11.478971 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afe1414-6c0a-4f4b-bd4c-940de18284f7 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:11.491265 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 179/372] 10.222.0.70 () {56 vars in 1099 bytes} [Fri Aug 19 15:53:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:11.492449 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afe1414-6c0a-4f4b-bd4c-940de18284f7 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:11.522197 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae0c02-e4a0-43b2-b1f8-ebb521e858d3 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:11.573725 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b285d-ceaf-42b8-b1d2-23adabbf3ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:11.574678 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b285d-ceaf-42b8-b1d2-23adabbf3ad3 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:11.575216 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b285d-ceaf-42b8-b1d2-23adabbf3ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:11.575700 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b285d-ceaf-42b8-b1d2-23adabbf3ad3 None admin] PATH_INFO: `/v3/groups/ee23f78826d64fc999d4841e3dbd61c6` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:11.577258 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b285d-ceaf-42b8-b1d2-23adabbf3ad3 None admin] RBAC: Authorizing `identity:get_group(group_id=ee23f78826d64fc999d4841e3dbd61c6)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:11.579115 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b285d-ceaf-42b8-b1d2-23adabbf3ad3 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:11.581429 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 194/373] 10.222.0.70 () {56 vars in 1180 bytes} [Fri Aug 19 15:53:11 2022] GET /identity/v3/groups/ee23f78826d64fc999d4841e3dbd61c6 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:11.582535 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b285d-ceaf-42b8-b1d2-23adabbf3ad3 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:11.594798 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:11.637670 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afe1414-6c0a-4f4b-bd4c-940de18284f7 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:11.655533 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:11.687027 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e15bef5-818f-4d12-93d7-0ce3dc4ef85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:11.687649 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15bef5-818f-4d12-93d7-0ce3dc4ef85c None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:11.687926 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15bef5-818f-4d12-93d7-0ce3dc4ef85c None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:11.688196 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15bef5-818f-4d12-93d7-0ce3dc4ef85c None admin] PATH_INFO: `/v3/groups/ee23f78826d64fc999d4841e3dbd61c6` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:11.689857 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e15bef5-818f-4d12-93d7-0ce3dc4ef85c None admin] RBAC: Authorizing `identity:get_group(group_id=ee23f78826d64fc999d4841e3dbd61c6)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:11.691275 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e15bef5-818f-4d12-93d7-0ce3dc4ef85c None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:11.693587 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 180/374] 10.222.0.70 () {56 vars in 1180 bytes} [Fri Aug 19 15:53:11 2022] GET /identity/v3/groups/ee23f78826d64fc999d4841e3dbd61c6 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:11.698789 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e15bef5-818f-4d12-93d7-0ce3dc4ef85c None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:11.726319 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b285d-ceaf-42b8-b1d2-23adabbf3ad3 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:11.773873 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950c23e-ebe0-4736-b73d-cea066365964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:11.774479 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950c23e-ebe0-4736-b73d-cea066365964 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:11.775370 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950c23e-ebe0-4736-b73d-cea066365964 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:11.775811 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950c23e-ebe0-4736-b73d-cea066365964 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:11.830714 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e15bef5-818f-4d12-93d7-0ce3dc4ef85c None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:11.859729 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0950c23e-ebe0-4736-b73d-cea066365964 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:11.861246 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0950c23e-ebe0-4736-b73d-cea066365964 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:11.871289 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:11.878447 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a1d03-8d20-4597-ada8-b45b730e74f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:11.879461 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a1d03-8d20-4597-ada8-b45b730e74f9 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:11.880489 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a1d03-8d20-4597-ada8-b45b730e74f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:11.881007 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a1d03-8d20-4597-ada8-b45b730e74f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:11.881967 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293a1d03-8d20-4597-ada8-b45b730e74f9 None admin] RBAC: Adding query filter params (group.id=ee23f78826d64fc999d4841e3dbd61c6, role.id=09971bc698e84205be000073fc048af2, scope.project.id=8299174a2d574620a12d3d2e42f01c55) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:11.882481 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293a1d03-8d20-4597-ada8-b45b730e74f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:11.884171 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293a1d03-8d20-4597-ada8-b45b730e74f9 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:11.890972 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 181/375] 10.222.0.70 () {56 vars in 1376 bytes} [Fri Aug 19 15:53:11 2022] GET /identity/v3/role_assignments?group.id=ee23f78826d64fc999d4841e3dbd61c6&scope.project.id=8299174a2d574620a12d3d2e42f01c55&role.id=09971bc698e84205be000073fc048af2 => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:11.892097 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a1d03-8d20-4597-ada8-b45b730e74f9 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:11.954458 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:11.986423 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 195/376] 10.222.0.70 () {58 vars in 1282 bytes} [Fri Aug 19 15:53:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:53:11.987323 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950c23e-ebe0-4736-b73d-cea066365964 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:12.032809 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a1d03-8d20-4597-ada8-b45b730e74f9 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:12.077010 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc470e9b-d857-4fdf-a274-db1336dc85f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:12.078003 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc470e9b-d857-4fdf-a274-db1336dc85f2 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:12.078654 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc470e9b-d857-4fdf-a274-db1336dc85f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:12.079137 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc470e9b-d857-4fdf-a274-db1336dc85f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:12.080186 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc470e9b-d857-4fdf-a274-db1336dc85f2 None admin] RBAC: Adding query filter params (group.id=ee23f78826d64fc999d4841e3dbd61c6, role.id=294bcd6132ef46d48aff3efa4d77fa0a, scope.project.id=8299174a2d574620a12d3d2e42f01c55) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:12.080728 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc470e9b-d857-4fdf-a274-db1336dc85f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:12.082645 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc470e9b-d857-4fdf-a274-db1336dc85f2 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:12.089846 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 182/377] 10.222.0.70 () {56 vars in 1376 bytes} [Fri Aug 19 15:53:11 2022] GET /identity/v3/role_assignments?group.id=ee23f78826d64fc999d4841e3dbd61c6&scope.project.id=8299174a2d574620a12d3d2e42f01c55&role.id=294bcd6132ef46d48aff3efa4d77fa0a => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:12.108779 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950c23e-ebe0-4736-b73d-cea066365964 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:12.117767 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:12.153242 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c9ed47-b161-4fb0-8342-3d7e36022b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:12.153891 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9ed47-b161-4fb0-8342-3d7e36022b3c None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:12.154165 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9ed47-b161-4fb0-8342-3d7e36022b3c None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:12.154435 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9ed47-b161-4fb0-8342-3d7e36022b3c None admin] PATH_INFO: `/v3/projects/e72646e5274546c7b7216d7348ce3bc4` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:12.155626 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c9ed47-b161-4fb0-8342-3d7e36022b3c None admin] RBAC: Authorizing `identity:get_project(project_id=e72646e5274546c7b7216d7348ce3bc4)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:12.157207 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c9ed47-b161-4fb0-8342-3d7e36022b3c None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:12.164017 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 196/378] 10.222.0.70 () {56 vars in 1186 bytes} [Fri Aug 19 15:53:11 2022] GET /identity/v3/projects/e72646e5274546c7b7216d7348ce3bc4 => generated 344 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:12.165640 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc470e9b-d857-4fdf-a274-db1336dc85f2 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:12.317639 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc470e9b-d857-4fdf-a274-db1336dc85f2 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:12.330523 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:12.373672 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4942124b-3b1d-4771-bbc7-e44d3c141810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:12.374775 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942124b-3b1d-4771-bbc7-e44d3c141810 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:12.375257 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942124b-3b1d-4771-bbc7-e44d3c141810 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:12.375755 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942124b-3b1d-4771-bbc7-e44d3c141810 None admin] PATH_INFO: `/v3/groups/1c3738e11394483dbeb328c00cf9f692` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:12.382716 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4942124b-3b1d-4771-bbc7-e44d3c141810 None admin] RBAC: Authorizing `identity:get_group(group_id=1c3738e11394483dbeb328c00cf9f692)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:12.384532 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4942124b-3b1d-4771-bbc7-e44d3c141810 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:12.386793 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 183/379] 10.222.0.70 () {56 vars in 1180 bytes} [Fri Aug 19 15:53:12 2022] GET /identity/v3/groups/1c3738e11394483dbeb328c00cf9f692 => generated 229 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:12.393998 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c9ed47-b161-4fb0-8342-3d7e36022b3c None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:12.527819 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c9ed47-b161-4fb0-8342-3d7e36022b3c None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:12.575165 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017dbb98-5d18-4a95-a7aa-c4b4b949200b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:12.576150 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017dbb98-5d18-4a95-a7aa-c4b4b949200b None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:12.576631 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017dbb98-5d18-4a95-a7aa-c4b4b949200b None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:12.577136 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017dbb98-5d18-4a95-a7aa-c4b4b949200b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:12.578059 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017dbb98-5d18-4a95-a7aa-c4b4b949200b None admin] RBAC: Adding query filter params (group.id=1c3738e11394483dbeb328c00cf9f692, role.id=2f6cb7d6ec874879972a12a63d61068d, scope.project.id=e72646e5274546c7b7216d7348ce3bc4) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:12.578588 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017dbb98-5d18-4a95-a7aa-c4b4b949200b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:12.580222 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017dbb98-5d18-4a95-a7aa-c4b4b949200b None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:12.586336 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 197/380] 10.222.0.70 () {56 vars in 1376 bytes} [Fri Aug 19 15:53:12 2022] GET /identity/v3/role_assignments?group.id=1c3738e11394483dbeb328c00cf9f692&scope.project.id=e72646e5274546c7b7216d7348ce3bc4&role.id=2f6cb7d6ec874879972a12a63d61068d => generated 260 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:12.975850 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6368ce-64c6-4dfe-9edf-d44fbfa0af1d None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:12.976383 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6368ce-64c6-4dfe-9edf-d44fbfa0af1d None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:12.976383 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6368ce-64c6-4dfe-9edf-d44fbfa0af1d None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:12.978976 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 184/381] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:53:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:53:12.985038 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2a55b-ffbf-41f0-afcd-e7a5131c0598 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:12.985547 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2a55b-ffbf-41f0-afcd-e7a5131c0598 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:12.985547 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2a55b-ffbf-41f0-afcd-e7a5131c0598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:13.013056 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-edf2a55b-ffbf-41f0-afcd-e7a5131c0598 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:53:13.014276 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-edf2a55b-ffbf-41f0-afcd-e7a5131c0598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:53:13.050584 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:13.097516 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 198/382] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:53:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:53:13.171331 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8958a4-1f8f-4bd2-96bf-fa241528a5ab None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:13.171712 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8958a4-1f8f-4bd2-96bf-fa241528a5ab None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:13.171987 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8958a4-1f8f-4bd2-96bf-fa241528a5ab None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:13.173642 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 185/383] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:53:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:53:13.179219 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078e9a0-5df5-41a8-a174-d0be493a3047 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:13.179808 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078e9a0-5df5-41a8-a174-d0be493a3047 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:13.180227 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078e9a0-5df5-41a8-a174-d0be493a3047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:13.203900 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-8078e9a0-5df5-41a8-a174-d0be493a3047 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:53:13.205174 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-8078e9a0-5df5-41a8-a174-d0be493a3047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:53:13.294588 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 199/384] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:53:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:53:13.566721 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8958a4-1f8f-4bd2-96bf-fa241528a5ab None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:13.698188 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8958a4-1f8f-4bd2-96bf-fa241528a5ab None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:13.746299 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fce59c-4489-446e-9fe4-827c76601087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:13.747296 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fce59c-4489-446e-9fe4-827c76601087 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:13.747812 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fce59c-4489-446e-9fe4-827c76601087 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:13.748282 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fce59c-4489-446e-9fe4-827c76601087 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:13.764083 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fce59c-4489-446e-9fe4-827c76601087 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:53:13.769671 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-16fce59c-4489-446e-9fe4-827c76601087 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:53:13.769671 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:13.769671 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:13.769671 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:13.769671 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:13.769671 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:13.769671 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:13.769671 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:13.769671 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:13.769671 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:13.769671 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:13.769671 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:13.769671 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:53:13.769671 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:53:13.769671 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:53:13.769671 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:53:13.770536 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:53:13.770536 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:53:13.770536 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:53:13.770536 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:53:13.770536 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:13.770536 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:13.770536 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:13.770536 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:13.770536 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:13.770536 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:13.770536 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:13.770536 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:13.770536 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:13.770536 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:13.770536 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:13.770536 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:13.771332 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:13.771332 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:13.771332 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:13.771332 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:13.771332 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:53:13.771332 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:53:13.771332 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:53:13.771332 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:53:13.771332 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:53:13.771332 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:53:13.771332 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:53:13.771332 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:53:13.773930 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 186/385] 10.222.0.70 () {56 vars in 1099 bytes} [Fri Aug 19 15:53:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:13.780732 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8078e9a0-5df5-41a8-a174-d0be493a3047 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:13.831771 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fce59c-4489-446e-9fe4-827c76601087 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:13.887690 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:13.929978 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:13.936296 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8078e9a0-5df5-41a8-a174-d0be493a3047 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:13.981081 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b8c558-2a32-40f1-9794-be84a78246c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:13.981942 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b8c558-2a32-40f1-9794-be84a78246c8 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:13.983445 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b8c558-2a32-40f1-9794-be84a78246c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:13.983877 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b8c558-2a32-40f1-9794-be84a78246c8 None admin] PATH_INFO: `/v3/roles` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:13.984748 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b8c558-2a32-40f1-9794-be84a78246c8 None admin] RBAC: Adding query filter params (name=member) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:13.985198 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b8c558-2a32-40f1-9794-be84a78246c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:13.987332 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b8c558-2a32-40f1-9794-be84a78246c8 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:13.998764 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 200/386] 10.222.0.70 () {56 vars in 1101 bytes} [Fri Aug 19 15:53:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:14.004892 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b8c558-2a32-40f1-9794-be84a78246c8 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:14.066869 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fce59c-4489-446e-9fe4-827c76601087 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:14.139633 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804a2a0-047d-49ae-9b1d-8288105e6b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:14.140190 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804a2a0-047d-49ae-9b1d-8288105e6b17 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:14.140471 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804a2a0-047d-49ae-9b1d-8288105e6b17 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:14.140767 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804a2a0-047d-49ae-9b1d-8288105e6b17 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:14.167221 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3804a2a0-047d-49ae-9b1d-8288105e6b17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:53:14.178660 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-3804a2a0-047d-49ae-9b1d-8288105e6b17 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 15:53:14.178660 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:14.178660 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:14.178660 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:14.178660 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:14.178660 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:14.178660 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:14.178660 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:14.178660 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:14.178660 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:14.178660 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:14.178660 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:14.178660 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:53:14.178660 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:53:14.178660 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:53:14.178660 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:53:14.179615 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:53:14.179615 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:53:14.179615 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:53:14.179615 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:53:14.179615 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:14.179615 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:14.179615 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:14.179615 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:14.179615 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:14.179615 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:14.179615 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:14.179615 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:14.179615 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:14.179615 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:14.179615 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:14.179615 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:14.180387 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:14.180387 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:14.180387 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:14.180387 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:14.180387 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:53:14.180387 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:53:14.180387 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:53:14.180387 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:53:14.180387 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:53:14.180387 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:53:14.180387 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 15:53:14.180387 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:53:14.186826 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 187/387] 10.222.0.70 () {56 vars in 1114 bytes} [Fri Aug 19 15:53:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:14.187941 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804a2a0-047d-49ae-9b1d-8288105e6b17 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:14.190286 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b8c558-2a32-40f1-9794-be84a78246c8 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:14.286748 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae3bfa-053b-4b0a-9212-ae73e5d971e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:14.287385 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae3bfa-053b-4b0a-9212-ae73e5d971e2 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:14.287657 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae3bfa-053b-4b0a-9212-ae73e5d971e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:14.287924 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae3bfa-053b-4b0a-9212-ae73e5d971e2 None admin] PATH_INFO: `/v3/groups/ee23f78826d64fc999d4841e3dbd61c6` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:14.289075 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae3bfa-053b-4b0a-9212-ae73e5d971e2 None admin] RBAC: Authorizing `identity:get_group(group_id=ee23f78826d64fc999d4841e3dbd61c6)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:14.291068 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae3bfa-053b-4b0a-9212-ae73e5d971e2 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:14.294439 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 201/388] 10.222.0.70 () {56 vars in 1180 bytes} [Fri Aug 19 15:53:14 2022] GET /identity/v3/groups/ee23f78826d64fc999d4841e3dbd61c6 => generated 226 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:14.299168 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae3bfa-053b-4b0a-9212-ae73e5d971e2 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:14.301650 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:14.313926 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804a2a0-047d-49ae-9b1d-8288105e6b17 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:14.342069 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:14.371410 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfbd44f-a0fe-48a3-9ed2-68897295ac21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:14.372335 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfbd44f-a0fe-48a3-9ed2-68897295ac21 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:14.372773 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfbd44f-a0fe-48a3-9ed2-68897295ac21 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:14.373228 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfbd44f-a0fe-48a3-9ed2-68897295ac21 None admin] PATH_INFO: `/v3/roles` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:14.374043 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfbd44f-a0fe-48a3-9ed2-68897295ac21 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:14.374603 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfbd44f-a0fe-48a3-9ed2-68897295ac21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:14.376183 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfbd44f-a0fe-48a3-9ed2-68897295ac21 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:14.394114 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 188/389] 10.222.0.70 () {56 vars in 1111 bytes} [Fri Aug 19 15:53:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:53:14.397538 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfbd44f-a0fe-48a3-9ed2-68897295ac21 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:14.488124 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae3bfa-053b-4b0a-9212-ae73e5d971e2 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:14.554400 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0f078-f461-40d6-bbdc-6477aa155147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:14.555316 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0f078-f461-40d6-bbdc-6477aa155147 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:14.555729 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0f078-f461-40d6-bbdc-6477aa155147 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:14.556260 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0f078-f461-40d6-bbdc-6477aa155147 None admin] PATH_INFO: `/v3/projects/2e809a1a094b48538c004035badbc88e` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:14.557923 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf0f078-f461-40d6-bbdc-6477aa155147 None admin] RBAC: Authorizing `identity:get_project(project_id=2e809a1a094b48538c004035badbc88e)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:14.560844 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf0f078-f461-40d6-bbdc-6477aa155147 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:14.563499 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 202/390] 10.222.0.70 () {56 vars in 1186 bytes} [Fri Aug 19 15:53:14 2022] GET /identity/v3/projects/2e809a1a094b48538c004035badbc88e => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:53:14.573502 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0f078-f461-40d6-bbdc-6477aa155147 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:14.599799 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfbd44f-a0fe-48a3-9ed2-68897295ac21 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:14.679782 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b172a550-1bff-4b13-917e-82dcd36c100e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:14.680690 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172a550-1bff-4b13-917e-82dcd36c100e None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:14.681753 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172a550-1bff-4b13-917e-82dcd36c100e None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:14.682533 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172a550-1bff-4b13-917e-82dcd36c100e None admin] PATH_INFO: `/v3/groups/ee23f78826d64fc999d4841e3dbd61c6` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:14.683931 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b172a550-1bff-4b13-917e-82dcd36c100e None admin] RBAC: Authorizing `identity:get_group(group_id=ee23f78826d64fc999d4841e3dbd61c6)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:14.692694 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b172a550-1bff-4b13-917e-82dcd36c100e None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:14.695303 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 189/391] 10.222.0.70 () {56 vars in 1180 bytes} [Fri Aug 19 15:53:14 2022] GET /identity/v3/groups/ee23f78826d64fc999d4841e3dbd61c6 => generated 226 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:14.700934 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b172a550-1bff-4b13-917e-82dcd36c100e None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:14.719084 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:14.735461 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0f078-f461-40d6-bbdc-6477aa155147 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:14.744704 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:14.787823 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362a97bb-4fa3-4836-8ad9-12bff52e4a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:14.788811 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a97bb-4fa3-4836-8ad9-12bff52e4a8d None admin] REQUEST_METHOD: `PUT` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:14.789252 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a97bb-4fa3-4836-8ad9-12bff52e4a8d None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:14.789671 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a97bb-4fa3-4836-8ad9-12bff52e4a8d None admin] PATH_INFO: `/v3/projects/2e809a1a094b48538c004035badbc88e/groups/ee23f78826d64fc999d4841e3dbd61c6/roles/09971bc698e84205be000073fc048af2` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:14.793303 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362a97bb-4fa3-4836-8ad9-12bff52e4a8d None admin] RBAC: Authorizing `identity:create_grant(project_id=2e809a1a094b48538c004035badbc88e, group_id=ee23f78826d64fc999d4841e3dbd61c6, role_id=09971bc698e84205be000073fc048af2)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:14.796202 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362a97bb-4fa3-4836-8ad9-12bff52e4a8d None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:14.862536 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b172a550-1bff-4b13-917e-82dcd36c100e None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:14.878068 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 203/392] 10.222.0.70 () {58 vars in 1442 bytes} [Fri Aug 19 15:53:14 2022] PUT /identity/v3/projects/2e809a1a094b48538c004035badbc88e/groups/ee23f78826d64fc999d4841e3dbd61c6/roles/09971bc698e84205be000073fc048af2 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:53:14.920319 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206efff-7ab5-4226-bfc8-6b75a8b013b4 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:14.920902 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206efff-7ab5-4226-bfc8-6b75a8b013b4 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:14.921322 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206efff-7ab5-4226-bfc8-6b75a8b013b4 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:14.923241 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 204/393] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:53:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:53:14.928767 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468cfeb1-b5a9-4fe3-937a-c57542e73928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:14.929680 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468cfeb1-b5a9-4fe3-937a-c57542e73928 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:14.933888 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316f101-c776-4b20-ae35-34862a7b4132 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:14.933888 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316f101-c776-4b20-ae35-34862a7b4132 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:14.934090 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468cfeb1-b5a9-4fe3-937a-c57542e73928 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:14.934164 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316f101-c776-4b20-ae35-34862a7b4132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:14.934231 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468cfeb1-b5a9-4fe3-937a-c57542e73928 None admin] PATH_INFO: `/v3/projects/2e809a1a094b48538c004035badbc88e` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:14.934231 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468cfeb1-b5a9-4fe3-937a-c57542e73928 None admin] RBAC: Authorizing `identity:get_project(project_id=2e809a1a094b48538c004035badbc88e)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:14.934669 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468cfeb1-b5a9-4fe3-937a-c57542e73928 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:14.937138 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 190/394] 10.222.0.70 () {56 vars in 1186 bytes} [Fri Aug 19 15:53:14 2022] GET /identity/v3/projects/2e809a1a094b48538c004035badbc88e => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:53:14.944388 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468cfeb1-b5a9-4fe3-937a-c57542e73928 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:14.971778 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-7316f101-c776-4b20-ae35-34862a7b4132 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:53:14.973398 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-7316f101-c776-4b20-ae35-34862a7b4132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:53:15.076695 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 205/395] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:53:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:53:15.078881 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d86cb9d-c0e3-462c-9674-90e4ecbcae11 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:15.079502 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d86cb9d-c0e3-462c-9674-90e4ecbcae11 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:15.079840 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d86cb9d-c0e3-462c-9674-90e4ecbcae11 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:15.085602 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 206/396] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:53:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:53:15.088028 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0d595-0e43-4e98-ab9b-83f12d5ac126 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:15.088311 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0d595-0e43-4e98-ab9b-83f12d5ac126 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:15.088577 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0d595-0e43-4e98-ab9b-83f12d5ac126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:15.104115 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:15.115355 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468cfeb1-b5a9-4fe3-937a-c57542e73928 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:15.116572 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-f7d0d595-0e43-4e98-ab9b-83f12d5ac126 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:53:15.119676 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-f7d0d595-0e43-4e98-ab9b-83f12d5ac126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:53:15.167532 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d662d0-b583-44a7-9c09-2b543f6c2704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:15.168535 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d662d0-b583-44a7-9c09-2b543f6c2704 None admin] REQUEST_METHOD: `PUT` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:15.168875 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d662d0-b583-44a7-9c09-2b543f6c2704 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:15.169156 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d662d0-b583-44a7-9c09-2b543f6c2704 None admin] PATH_INFO: `/v3/projects/2e809a1a094b48538c004035badbc88e/groups/ee23f78826d64fc999d4841e3dbd61c6/roles/294bcd6132ef46d48aff3efa4d77fa0a` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:15.172698 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d662d0-b583-44a7-9c09-2b543f6c2704 None admin] RBAC: Authorizing `identity:create_grant(project_id=2e809a1a094b48538c004035badbc88e, group_id=ee23f78826d64fc999d4841e3dbd61c6, role_id=294bcd6132ef46d48aff3efa4d77fa0a)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:15.174310 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d662d0-b583-44a7-9c09-2b543f6c2704 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:15.217958 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 207/397] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:53:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:53:15.260187 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 191/398] 10.222.0.70 () {58 vars in 1442 bytes} [Fri Aug 19 15:53:14 2022] PUT /identity/v3/projects/2e809a1a094b48538c004035badbc88e/groups/ee23f78826d64fc999d4841e3dbd61c6/roles/294bcd6132ef46d48aff3efa4d77fa0a => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:53:15.487025 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d0d595-0e43-4e98-ab9b-83f12d5ac126 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:15.507603 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:15.507788 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59584858-e79e-4f11-8bb0-a3a481913f7d None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:15.508006 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59584858-e79e-4f11-8bb0-a3a481913f7d None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:15.508259 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59584858-e79e-4f11-8bb0-a3a481913f7d None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:15.510461 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 192/399] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:53:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:53:15.515616 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5576b40-28a4-4578-857e-c91f624cde48 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:15.515890 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5576b40-28a4-4578-857e-c91f624cde48 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:15.516162 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5576b40-28a4-4578-857e-c91f624cde48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:15.538080 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-d5576b40-28a4-4578-857e-c91f624cde48 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:53:15.539279 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-d5576b40-28a4-4578-857e-c91f624cde48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:53:15.609953 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d0d595-0e43-4e98-ab9b-83f12d5ac126 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:15.634795 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 193/400] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:53:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:53:15.660170 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af19864-871e-464b-8dca-2a09574b6df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:15.660843 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af19864-871e-464b-8dca-2a09574b6df9 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:15.661126 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af19864-871e-464b-8dca-2a09574b6df9 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:15.661397 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af19864-871e-464b-8dca-2a09574b6df9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:15.672468 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5576b40-28a4-4578-857e-c91f624cde48 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:15.676846 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af19864-871e-464b-8dca-2a09574b6df9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:53:15.682402 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-2af19864-871e-464b-8dca-2a09574b6df9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:53:15.682402 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:15.682402 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:15.682402 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:15.682402 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:15.682402 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:15.682402 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:15.682402 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:15.682402 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:15.682402 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:15.682402 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:15.682402 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:15.682402 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:53:15.682402 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:53:15.682402 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:53:15.682402 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:53:15.683301 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:53:15.683301 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:53:15.683301 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:53:15.683301 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:53:15.683301 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:15.683301 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:15.683301 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:15.683301 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:15.683301 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:15.683301 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:15.683301 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:15.683301 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:15.683301 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:15.683301 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:15.683301 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:15.683301 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:15.684084 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:15.684084 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:15.684084 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:15.684084 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:15.684084 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:53:15.684084 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:53:15.684084 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:53:15.684084 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:53:15.684084 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:53:15.684084 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:53:15.684084 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:53:15.684084 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:15.684084 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 208/401] 10.222.0.70 () {56 vars in 1099 bytes} [Fri Aug 19 15:53:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:15.690255 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af19864-871e-464b-8dca-2a09574b6df9 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:15.780987 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:15.807281 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af19864-871e-464b-8dca-2a09574b6df9 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:15.845278 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:15.864983 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5576b40-28a4-4578-857e-c91f624cde48 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:15.877852 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f133f-d7d5-4d68-b7f8-6dc4489d8e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:15.878890 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f133f-d7d5-4d68-b7f8-6dc4489d8e9e None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:15.879368 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f133f-d7d5-4d68-b7f8-6dc4489d8e9e None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:15.879838 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f133f-d7d5-4d68-b7f8-6dc4489d8e9e None admin] PATH_INFO: `/v3/roles` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:15.880783 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f133f-d7d5-4d68-b7f8-6dc4489d8e9e None admin] RBAC: Adding query filter params (name=member) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:15.885636 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f133f-d7d5-4d68-b7f8-6dc4489d8e9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:15.885636 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f133f-d7d5-4d68-b7f8-6dc4489d8e9e None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:15.897230 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63030dd-fd22-4e49-a0b1-1e5e33a4467e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:15.897879 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63030dd-fd22-4e49-a0b1-1e5e33a4467e None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:15.898152 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63030dd-fd22-4e49-a0b1-1e5e33a4467e None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:15.898424 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63030dd-fd22-4e49-a0b1-1e5e33a4467e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:15.901008 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 209/402] 10.222.0.70 () {56 vars in 1101 bytes} [Fri Aug 19 15:53:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:15.906505 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f133f-d7d5-4d68-b7f8-6dc4489d8e9e None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:15.909886 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63030dd-fd22-4e49-a0b1-1e5e33a4467e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:53:15.915482 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-a63030dd-fd22-4e49-a0b1-1e5e33a4467e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 15:53:15.915482 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:15.915482 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:15.915482 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:15.915482 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:15.915482 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:15.915482 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:15.915482 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:15.915482 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:15.915482 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:15.915482 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:15.915482 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:15.915482 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:53:15.915482 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:53:15.915482 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:53:15.915482 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:53:15.916409 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:53:15.916409 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:53:15.916409 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:53:15.916409 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:53:15.916409 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:15.916409 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:15.916409 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:15.916409 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:15.916409 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:15.916409 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:15.916409 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:15.916409 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:15.916409 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:15.916409 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:15.916409 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:15.916409 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:15.917333 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:15.917333 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:15.917333 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:15.917333 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:15.917333 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:53:15.917333 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:53:15.917333 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:53:15.917333 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:53:15.917333 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:53:15.917333 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:53:15.917333 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 15:53:15.917333 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:53:15.917333 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 194/403] 10.222.0.70 () {56 vars in 1114 bytes} [Fri Aug 19 15:53:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:53:15.923690 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63030dd-fd22-4e49-a0b1-1e5e33a4467e None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:16.045679 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63030dd-fd22-4e49-a0b1-1e5e33a4467e None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:16.086147 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edbb888-9ea2-4c70-bc4e-67ead727633c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:16.086754 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbb888-9ea2-4c70-bc4e-67ead727633c None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:16.087028 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbb888-9ea2-4c70-bc4e-67ead727633c None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:16.087617 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbb888-9ea2-4c70-bc4e-67ead727633c None admin] PATH_INFO: `/v3/roles` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:16.088567 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edbb888-9ea2-4c70-bc4e-67ead727633c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:16.088901 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edbb888-9ea2-4c70-bc4e-67ead727633c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:16.090830 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edbb888-9ea2-4c70-bc4e-67ead727633c None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:16.100931 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 195/404] 10.222.0.70 () {56 vars in 1111 bytes} [Fri Aug 19 15:53:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:16.102034 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edbb888-9ea2-4c70-bc4e-67ead727633c None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:16.109171 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:16.132419 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f133f-d7d5-4d68-b7f8-6dc4489d8e9e None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:16.175273 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be44d06-c85a-406b-9468-dc1b40187981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:16.176000 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be44d06-c85a-406b-9468-dc1b40187981 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:16.176278 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be44d06-c85a-406b-9468-dc1b40187981 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:16.176687 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be44d06-c85a-406b-9468-dc1b40187981 None admin] PATH_INFO: `/v3/groups/ee23f78826d64fc999d4841e3dbd61c6` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:16.177807 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be44d06-c85a-406b-9468-dc1b40187981 None admin] RBAC: Authorizing `identity:get_group(group_id=ee23f78826d64fc999d4841e3dbd61c6)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:16.179230 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be44d06-c85a-406b-9468-dc1b40187981 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:16.182143 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 210/405] 10.222.0.70 () {56 vars in 1180 bytes} [Fri Aug 19 15:53:15 2022] GET /identity/v3/groups/ee23f78826d64fc999d4841e3dbd61c6 => generated 226 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:53:16.183196 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be44d06-c85a-406b-9468-dc1b40187981 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:16.192754 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:16.225330 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edbb888-9ea2-4c70-bc4e-67ead727633c None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:16.266407 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4afa59-aa5b-4e34-ba67-8ce805fbb43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:16.267342 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4afa59-aa5b-4e34-ba67-8ce805fbb43a None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:16.267767 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4afa59-aa5b-4e34-ba67-8ce805fbb43a None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:16.268292 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4afa59-aa5b-4e34-ba67-8ce805fbb43a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:16.281289 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4afa59-aa5b-4e34-ba67-8ce805fbb43a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:53:16.287138 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-0f4afa59-aa5b-4e34-ba67-8ce805fbb43a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:53:16.287138 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:16.287138 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:16.287138 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:16.287138 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:16.287138 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:16.287138 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:16.287138 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:16.287138 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:16.287138 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:16.287138 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:16.287138 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:16.287138 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:53:16.287138 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:53:16.287138 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:53:16.287138 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:53:16.288198 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:53:16.288198 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:53:16.288198 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:53:16.288198 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:53:16.288198 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:16.288198 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:16.288198 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:16.288198 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:16.288198 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:16.288198 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:16.288198 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:16.288198 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:16.288198 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:16.288198 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:16.288198 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:16.288198 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:16.289122 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:16.289122 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:16.289122 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:16.289122 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:16.289122 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:53:16.289122 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:53:16.289122 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:53:16.289122 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:53:16.289122 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:53:16.289122 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:53:16.289122 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:53:16.289122 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:53:16.291067 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 196/406] 10.222.0.70 () {56 vars in 1096 bytes} [Fri Aug 19 15:53:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:16.296557 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be44d06-c85a-406b-9468-dc1b40187981 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:16.297013 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4afa59-aa5b-4e34-ba67-8ce805fbb43a None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:16.333738 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a764aad-8902-4618-8378-d5a3760c3664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:16.334462 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a764aad-8902-4618-8378-d5a3760c3664 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:16.334946 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a764aad-8902-4618-8378-d5a3760c3664 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:16.335235 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a764aad-8902-4618-8378-d5a3760c3664 None admin] PATH_INFO: `/v3/groups/ee23f78826d64fc999d4841e3dbd61c6` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:16.336719 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a764aad-8902-4618-8378-d5a3760c3664 None admin] RBAC: Authorizing `identity:get_group(group_id=ee23f78826d64fc999d4841e3dbd61c6)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:16.339125 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a764aad-8902-4618-8378-d5a3760c3664 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:16.344712 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 211/407] 10.222.0.70 () {56 vars in 1180 bytes} [Fri Aug 19 15:53:16 2022] GET /identity/v3/groups/ee23f78826d64fc999d4841e3dbd61c6 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:16.344712 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a764aad-8902-4618-8378-d5a3760c3664 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:16.373718 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:16.420957 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4afa59-aa5b-4e34-ba67-8ce805fbb43a None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:16.431302 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:16.458260 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a764aad-8902-4618-8378-d5a3760c3664 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:16.458821 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f61ae-86ee-4a10-945f-69162b6e7578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:16.459649 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f61ae-86ee-4a10-945f-69162b6e7578 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:16.460103 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f61ae-86ee-4a10-945f-69162b6e7578 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:16.460570 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f61ae-86ee-4a10-945f-69162b6e7578 None admin] PATH_INFO: `/v3/projects/8299174a2d574620a12d3d2e42f01c55` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:16.461950 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197f61ae-86ee-4a10-945f-69162b6e7578 None admin] RBAC: Authorizing `identity:get_project(project_id=8299174a2d574620a12d3d2e42f01c55)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:16.464251 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197f61ae-86ee-4a10-945f-69162b6e7578 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:16.471716 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 197/408] 10.222.0.70 () {56 vars in 1186 bytes} [Fri Aug 19 15:53:16 2022] GET /identity/v3/projects/8299174a2d574620a12d3d2e42f01c55 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:16.473219 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f61ae-86ee-4a10-945f-69162b6e7578 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:16.496939 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce798ea4-99e5-436d-b904-3a6e21e3de3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:16.497617 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce798ea4-99e5-436d-b904-3a6e21e3de3a None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:16.498244 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce798ea4-99e5-436d-b904-3a6e21e3de3a None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:16.498244 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce798ea4-99e5-436d-b904-3a6e21e3de3a None admin] PATH_INFO: `/v3/roles` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:16.498890 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce798ea4-99e5-436d-b904-3a6e21e3de3a None admin] RBAC: Adding query filter params (name=admin) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:16.499192 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce798ea4-99e5-436d-b904-3a6e21e3de3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:16.500553 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce798ea4-99e5-436d-b904-3a6e21e3de3a None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:16.515105 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 212/409] 10.222.0.70 () {56 vars in 1099 bytes} [Fri Aug 19 15:53:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:16.515105 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce798ea4-99e5-436d-b904-3a6e21e3de3a None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:16.595473 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f61ae-86ee-4a10-945f-69162b6e7578 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:16.628107 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:16.631648 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce798ea4-99e5-436d-b904-3a6e21e3de3a None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:16.635068 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b2cc7-e802-4148-b1aa-a1862cf61cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:16.635273 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b2cc7-e802-4148-b1aa-a1862cf61cda None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:16.635739 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b2cc7-e802-4148-b1aa-a1862cf61cda None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:16.636022 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b2cc7-e802-4148-b1aa-a1862cf61cda None admin] PATH_INFO: `/v3/projects/8299174a2d574620a12d3d2e42f01c55` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:16.637263 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0b2cc7-e802-4148-b1aa-a1862cf61cda None admin] RBAC: Authorizing `identity:get_project(project_id=8299174a2d574620a12d3d2e42f01c55)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:16.638811 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0b2cc7-e802-4148-b1aa-a1862cf61cda None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:16.640827 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 198/410] 10.222.0.70 () {56 vars in 1186 bytes} [Fri Aug 19 15:53:16 2022] GET /identity/v3/projects/8299174a2d574620a12d3d2e42f01c55 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:16.651076 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b2cc7-e802-4148-b1aa-a1862cf61cda None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:16.674283 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2b5e4-8106-46b1-b09a-b29555f2aa93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:16.675318 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2b5e4-8106-46b1-b09a-b29555f2aa93 None admin] REQUEST_METHOD: `PUT` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:16.675811 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2b5e4-8106-46b1-b09a-b29555f2aa93 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:16.676278 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2b5e4-8106-46b1-b09a-b29555f2aa93 None admin] PATH_INFO: `/v3/projects/8299174a2d574620a12d3d2e42f01c55/groups/ee23f78826d64fc999d4841e3dbd61c6/roles/09971bc698e84205be000073fc048af2` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:16.678472 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a2b5e4-8106-46b1-b09a-b29555f2aa93 None admin] RBAC: Authorizing `identity:create_grant(project_id=8299174a2d574620a12d3d2e42f01c55, group_id=ee23f78826d64fc999d4841e3dbd61c6, role_id=09971bc698e84205be000073fc048af2)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:16.680113 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a2b5e4-8106-46b1-b09a-b29555f2aa93 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:16.684693 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:16.750860 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b2cc7-e802-4148-b1aa-a1862cf61cda None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:16.790186 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 213/411] 10.222.0.70 () {58 vars in 1442 bytes} [Fri Aug 19 15:53:16 2022] PUT /identity/v3/projects/8299174a2d574620a12d3d2e42f01c55/groups/ee23f78826d64fc999d4841e3dbd61c6/roles/09971bc698e84205be000073fc048af2 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:53:16.790186 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2b5e4-8106-46b1-b09a-b29555f2aa93 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:16.805661 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c48d0-5854-4262-8c31-2612bde0f8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:16.806816 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c48d0-5854-4262-8c31-2612bde0f8f5 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:16.807315 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c48d0-5854-4262-8c31-2612bde0f8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:16.807689 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c48d0-5854-4262-8c31-2612bde0f8f5 None admin] PATH_INFO: `/v3/groups/1c3738e11394483dbeb328c00cf9f692` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:16.809053 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168c48d0-5854-4262-8c31-2612bde0f8f5 None admin] RBAC: Authorizing `identity:get_group(group_id=1c3738e11394483dbeb328c00cf9f692)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:16.811890 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168c48d0-5854-4262-8c31-2612bde0f8f5 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:16.816216 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 199/412] 10.222.0.70 () {56 vars in 1180 bytes} [Fri Aug 19 15:53:16 2022] GET /identity/v3/groups/1c3738e11394483dbeb328c00cf9f692 => generated 229 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:16.820516 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c48d0-5854-4262-8c31-2612bde0f8f5 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:16.935554 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:17.017408 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2b5e4-8106-46b1-b09a-b29555f2aa93 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:17.021977 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c48d0-5854-4262-8c31-2612bde0f8f5 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:17.063223 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a3f4f5-8194-4ac1-8a68-e29d7c6381d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:17.064148 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3f4f5-8194-4ac1-8a68-e29d7c6381d3 None admin] REQUEST_METHOD: `PUT` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:17.064428 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3f4f5-8194-4ac1-8a68-e29d7c6381d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:17.065145 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3f4f5-8194-4ac1-8a68-e29d7c6381d3 None admin] PATH_INFO: `/v3/projects/8299174a2d574620a12d3d2e42f01c55/groups/ee23f78826d64fc999d4841e3dbd61c6/roles/294bcd6132ef46d48aff3efa4d77fa0a` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:17.067576 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a3f4f5-8194-4ac1-8a68-e29d7c6381d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=8299174a2d574620a12d3d2e42f01c55, group_id=ee23f78826d64fc999d4841e3dbd61c6, role_id=294bcd6132ef46d48aff3efa4d77fa0a)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:17.069195 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a3f4f5-8194-4ac1-8a68-e29d7c6381d3 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:17.069866 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88ca239-5c23-4c53-9a52-511088aa4d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:17.070544 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ca239-5c23-4c53-9a52-511088aa4d7c None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:17.070884 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ca239-5c23-4c53-9a52-511088aa4d7c None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:17.071215 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ca239-5c23-4c53-9a52-511088aa4d7c None admin] PATH_INFO: `/v3/projects/e72646e5274546c7b7216d7348ce3bc4` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:17.073881 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88ca239-5c23-4c53-9a52-511088aa4d7c None admin] RBAC: Authorizing `identity:get_project(project_id=e72646e5274546c7b7216d7348ce3bc4)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:17.077415 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88ca239-5c23-4c53-9a52-511088aa4d7c None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:17.079389 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 200/413] 10.222.0.70 () {56 vars in 1186 bytes} [Fri Aug 19 15:53:16 2022] GET /identity/v3/projects/e72646e5274546c7b7216d7348ce3bc4 => generated 344 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:17.085283 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88ca239-5c23-4c53-9a52-511088aa4d7c None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:17.153733 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 214/414] 10.222.0.70 () {58 vars in 1442 bytes} [Fri Aug 19 15:53:16 2022] PUT /identity/v3/projects/8299174a2d574620a12d3d2e42f01c55/groups/ee23f78826d64fc999d4841e3dbd61c6/roles/294bcd6132ef46d48aff3efa4d77fa0a => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:53:17.216117 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88ca239-5c23-4c53-9a52-511088aa4d7c None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:17.266447 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bee55e-b765-4ef8-8e7f-7391a8980d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:17.267184 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bee55e-b765-4ef8-8e7f-7391a8980d55 None admin] REQUEST_METHOD: `PUT` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:17.267462 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bee55e-b765-4ef8-8e7f-7391a8980d55 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:17.267733 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bee55e-b765-4ef8-8e7f-7391a8980d55 None admin] PATH_INFO: `/v3/projects/e72646e5274546c7b7216d7348ce3bc4/groups/1c3738e11394483dbeb328c00cf9f692/roles/2f6cb7d6ec874879972a12a63d61068d` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:17.271622 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bee55e-b765-4ef8-8e7f-7391a8980d55 None admin] RBAC: Authorizing `identity:create_grant(project_id=e72646e5274546c7b7216d7348ce3bc4, group_id=1c3738e11394483dbeb328c00cf9f692, role_id=2f6cb7d6ec874879972a12a63d61068d)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:17.273172 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bee55e-b765-4ef8-8e7f-7391a8980d55 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:17.276636 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:17.362453 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 201/415] 10.222.0.70 () {58 vars in 1442 bytes} [Fri Aug 19 15:53:17 2022] PUT /identity/v3/projects/e72646e5274546c7b7216d7348ce3bc4/groups/1c3738e11394483dbeb328c00cf9f692/roles/2f6cb7d6ec874879972a12a63d61068d => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:53:17.414213 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592e5bd-748d-40e8-b6a2-d44c7cc8a58d None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:17.414567 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592e5bd-748d-40e8-b6a2-d44c7cc8a58d None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:17.414767 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592e5bd-748d-40e8-b6a2-d44c7cc8a58d None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:17.417262 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 215/416] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:53:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:53:17.423577 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bf5b2-5933-4b5c-b52b-04e4685b65cd None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:17.423925 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bf5b2-5933-4b5c-b52b-04e4685b65cd None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:17.424132 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bf5b2-5933-4b5c-b52b-04e4685b65cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:17.457508 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-263bf5b2-5933-4b5c-b52b-04e4685b65cd None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:53:17.458804 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-263bf5b2-5933-4b5c-b52b-04e4685b65cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:53:17.559343 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 202/417] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:53:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:53:17.923009 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35dd3b-a525-4cea-829c-5219c06f240d None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:17.923347 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35dd3b-a525-4cea-829c-5219c06f240d None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:17.923469 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35dd3b-a525-4cea-829c-5219c06f240d None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:17.924833 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 216/418] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:53:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:53:17.930131 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f65c4c-7ee5-4a05-8751-a9e014dd0ac2 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:17.930409 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f65c4c-7ee5-4a05-8751-a9e014dd0ac2 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:17.930675 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f65c4c-7ee5-4a05-8751-a9e014dd0ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:17.950315 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-64f65c4c-7ee5-4a05-8751-a9e014dd0ac2 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:53:17.951496 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-64f65c4c-7ee5-4a05-8751-a9e014dd0ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:53:18.003907 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd35dd3b-a525-4cea-829c-5219c06f240d None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:18.039568 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 203/419] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:53:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:53:18.095144 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:18.161390 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd35dd3b-a525-4cea-829c-5219c06f240d None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:18.203879 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2eccb1-5aa3-4ddb-b3a2-b62a919cd71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:18.204430 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2eccb1-5aa3-4ddb-b3a2-b62a919cd71e None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:18.204734 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2eccb1-5aa3-4ddb-b3a2-b62a919cd71e None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:18.205010 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2eccb1-5aa3-4ddb-b3a2-b62a919cd71e None admin] PATH_INFO: `/v3/roles/member` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:18.222186 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2eccb1-5aa3-4ddb-b3a2-b62a919cd71e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:53:18.229609 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-4b2eccb1-5aa3-4ddb-b3a2-b62a919cd71e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:53:18.229609 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:18.229609 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:18.229609 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:18.229609 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:18.229609 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:18.229609 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:18.229609 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:18.229609 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:18.229609 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:18.229609 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:18.229609 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:18.229609 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:53:18.229609 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:53:18.229609 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:53:18.229609 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:53:18.230562 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:53:18.230562 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:53:18.230562 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:53:18.230562 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:53:18.230562 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:18.230562 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:18.230562 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:18.230562 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:18.230562 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:18.230562 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:18.230562 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:18.230562 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:18.230562 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:18.230562 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:18.230562 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:18.230562 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:18.231345 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:18.231345 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:18.231345 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:18.231345 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:18.231345 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:53:18.231345 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:53:18.231345 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:53:18.231345 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:53:18.231345 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:53:18.231345 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:53:18.231345 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:53:18.231345 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:18.231345 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 217/420] 10.222.0.70 () {56 vars in 1099 bytes} [Fri Aug 19 15:53:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:18.237000 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f65c4c-7ee5-4a05-8751-a9e014dd0ac2 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:18.315229 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:18.383603 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f65c4c-7ee5-4a05-8751-a9e014dd0ac2 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:18.439174 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06431320-563e-41b9-89d9-3c7cce38da1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:18.439834 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06431320-563e-41b9-89d9-3c7cce38da1c None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:18.440113 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06431320-563e-41b9-89d9-3c7cce38da1c None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:18.440381 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06431320-563e-41b9-89d9-3c7cce38da1c None admin] PATH_INFO: `/v3/roles` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:18.441064 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06431320-563e-41b9-89d9-3c7cce38da1c None admin] RBAC: Adding query filter params (name=member) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:18.441364 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06431320-563e-41b9-89d9-3c7cce38da1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:18.442731 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06431320-563e-41b9-89d9-3c7cce38da1c None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:18.456276 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 204/421] 10.222.0.70 () {56 vars in 1101 bytes} [Fri Aug 19 15:53:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:18.461724 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2eccb1-5aa3-4ddb-b3a2-b62a919cd71e None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:18.600028 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2eccb1-5aa3-4ddb-b3a2-b62a919cd71e None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:18.617345 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:18.633819 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06431320-563e-41b9-89d9-3c7cce38da1c None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:18.636644 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a556f30-43c6-4b27-b150-e985a49d6185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:18.637277 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a556f30-43c6-4b27-b150-e985a49d6185 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:18.637550 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a556f30-43c6-4b27-b150-e985a49d6185 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:18.637818 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a556f30-43c6-4b27-b150-e985a49d6185 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:18.714476 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a556f30-43c6-4b27-b150-e985a49d6185 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:18.715969 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a556f30-43c6-4b27-b150-e985a49d6185 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:18.875230 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06431320-563e-41b9-89d9-3c7cce38da1c None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:18.897407 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:18.901321 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 218/422] 10.222.0.70 () {58 vars in 1282 bytes} [Fri Aug 19 15:53:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:53:18.906997 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a556f30-43c6-4b27-b150-e985a49d6185 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:18.923743 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d9597-cf1e-44e7-bba5-a87b6c9a05b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:18.924378 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d9597-cf1e-44e7-bba5-a87b6c9a05b5 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:18.924739 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d9597-cf1e-44e7-bba5-a87b6c9a05b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:18.925017 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d9597-cf1e-44e7-bba5-a87b6c9a05b5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:18.936989 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216d9597-cf1e-44e7-bba5-a87b6c9a05b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:53:18.941630 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:18.942299 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-216d9597-cf1e-44e7-bba5-a87b6c9a05b5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 15:53:18.942299 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:18.942299 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:18.942299 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:18.942299 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:18.942299 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:18.942299 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:18.942299 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:18.942299 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:18.942299 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:18.942299 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:18.942299 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:18.942299 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:53:18.942299 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:53:18.942299 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:53:18.942299 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:53:18.943144 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:53:18.943144 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:53:18.943144 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:53:18.943144 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:53:18.943144 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:18.943144 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:18.943144 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:18.943144 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:18.943144 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:18.943144 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:18.943144 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:18.943144 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:18.943144 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:18.943144 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:18.943144 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:18.943144 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:18.943927 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:18.943927 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:18.943927 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:18.943927 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:18.943927 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:53:18.943927 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:53:18.943927 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:53:18.943927 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:53:18.943927 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:53:18.943927 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:53:18.943927 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 15:53:18.943927 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:53:18.943927 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 205/423] 10.222.0.70 () {56 vars in 1114 bytes} [Fri Aug 19 15:53:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:53:18.950896 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d9597-cf1e-44e7-bba5-a87b6c9a05b5 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:19.066854 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d9597-cf1e-44e7-bba5-a87b6c9a05b5 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:19.105598 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726ba20-bfe2-4569-967f-fe4c50e3ac82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:19.106410 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726ba20-bfe2-4569-967f-fe4c50e3ac82 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:19.106684 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726ba20-bfe2-4569-967f-fe4c50e3ac82 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:19.106948 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726ba20-bfe2-4569-967f-fe4c50e3ac82 None admin] PATH_INFO: `/v3/roles` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:19.107600 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1726ba20-bfe2-4569-967f-fe4c50e3ac82 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:19.107896 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1726ba20-bfe2-4569-967f-fe4c50e3ac82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:19.109336 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1726ba20-bfe2-4569-967f-fe4c50e3ac82 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:19.119370 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 206/424] 10.222.0.70 () {56 vars in 1111 bytes} [Fri Aug 19 15:53:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:19.128282 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726ba20-bfe2-4569-967f-fe4c50e3ac82 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:19.181208 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:19.229300 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a556f30-43c6-4b27-b150-e985a49d6185 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:19.250617 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726ba20-bfe2-4569-967f-fe4c50e3ac82 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:19.294221 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bfd951-c4b9-4613-b641-ad941f3aaa31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:19.294837 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfd951-c4b9-4613-b641-ad941f3aaa31 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:19.295113 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfd951-c4b9-4613-b641-ad941f3aaa31 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:19.295382 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfd951-c4b9-4613-b641-ad941f3aaa31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:19.297507 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4be440f-a0de-4ae6-a186-027a761aa872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:19.298148 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be440f-a0de-4ae6-a186-027a761aa872 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:19.298414 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be440f-a0de-4ae6-a186-027a761aa872 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:19.298679 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be440f-a0de-4ae6-a186-027a761aa872 None admin] PATH_INFO: `/v3/projects/2e809a1a094b48538c004035badbc88e` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:19.300147 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4be440f-a0de-4ae6-a186-027a761aa872 None admin] RBAC: Authorizing `identity:get_project(project_id=2e809a1a094b48538c004035badbc88e)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:19.303786 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4be440f-a0de-4ae6-a186-027a761aa872 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:19.310744 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 219/425] 10.222.0.70 () {56 vars in 1186 bytes} [Fri Aug 19 15:53:18 2022] GET /identity/v3/projects/2e809a1a094b48538c004035badbc88e => generated 298 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:53:19.313004 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4be440f-a0de-4ae6-a186-027a761aa872 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:19.463603 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bfd951-c4b9-4613-b641-ad941f3aaa31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:19.465118 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bfd951-c4b9-4613-b641-ad941f3aaa31 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:19.509067 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:19.537025 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:19.543072 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4be440f-a0de-4ae6-a186-027a761aa872 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:19.580606 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b2c1a-e96e-406b-875b-a58b356ffa7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:19.581532 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b2c1a-e96e-406b-875b-a58b356ffa7f None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:19.582042 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b2c1a-e96e-406b-875b-a58b356ffa7f None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:19.582455 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b2c1a-e96e-406b-875b-a58b356ffa7f None admin] PATH_INFO: `/v3/groups/ee23f78826d64fc999d4841e3dbd61c6` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:19.583739 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258b2c1a-e96e-406b-875b-a58b356ffa7f None admin] RBAC: Authorizing `identity:get_group(group_id=ee23f78826d64fc999d4841e3dbd61c6)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:19.585526 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258b2c1a-e96e-406b-875b-a58b356ffa7f None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:19.588166 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 220/426] 10.222.0.70 () {56 vars in 1180 bytes} [Fri Aug 19 15:53:19 2022] GET /identity/v3/groups/ee23f78826d64fc999d4841e3dbd61c6 => generated 226 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:19.589940 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb182157-a074-4886-97f0-dfc99c786190 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:19.590367 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb182157-a074-4886-97f0-dfc99c786190 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:19.590780 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb182157-a074-4886-97f0-dfc99c786190 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:19.596425 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 221/427] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:53:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:53:19.597550 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb182157-a074-4886-97f0-dfc99c786190 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:19.616327 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 207/428] 10.222.0.70 () {58 vars in 1282 bytes} [Fri Aug 19 15:53:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:53:19.616327 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b26ed-c998-404b-99fe-c5b9f97e0355 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:19.616327 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b26ed-c998-404b-99fe-c5b9f97e0355 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:19.616327 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b26ed-c998-404b-99fe-c5b9f97e0355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:19.632002 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-2d3b26ed-c998-404b-99fe-c5b9f97e0355 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:53:19.633308 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-2d3b26ed-c998-404b-99fe-c5b9f97e0355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:53:19.703979 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 208/429] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:53:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:53:19.705051 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b26ed-c998-404b-99fe-c5b9f97e0355 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:19.778305 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:19.811488 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b26ed-c998-404b-99fe-c5b9f97e0355 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:19.828740 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb182157-a074-4886-97f0-dfc99c786190 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:19.883857 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf006d-073d-4104-8484-77a1383a1a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:19.885337 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf006d-073d-4104-8484-77a1383a1a71 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:19.885613 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf006d-073d-4104-8484-77a1383a1a71 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:19.885886 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf006d-073d-4104-8484-77a1383a1a71 None admin] PATH_INFO: `/v3/projects/2e809a1a094b48538c004035badbc88e` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:19.887482 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf006d-073d-4104-8484-77a1383a1a71 None admin] RBAC: Authorizing `identity:get_project(project_id=2e809a1a094b48538c004035badbc88e)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:19.889260 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf006d-073d-4104-8484-77a1383a1a71 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:19.892050 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 209/430] 10.222.0.70 () {56 vars in 1186 bytes} [Fri Aug 19 15:53:19 2022] GET /identity/v3/projects/2e809a1a094b48538c004035badbc88e => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:19.898495 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf006d-073d-4104-8484-77a1383a1a71 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:19.914990 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a8d3f-121c-4591-ba61-560c2fe664e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:19.916460 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a8d3f-121c-4591-ba61-560c2fe664e9 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:19.916930 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a8d3f-121c-4591-ba61-560c2fe664e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:19.917352 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a8d3f-121c-4591-ba61-560c2fe664e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:19.918219 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26a8d3f-121c-4591-ba61-560c2fe664e9 None admin] RBAC: Adding query filter params (group.id=ee23f78826d64fc999d4841e3dbd61c6, role.id=09971bc698e84205be000073fc048af2, scope.project.id=2e809a1a094b48538c004035badbc88e) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:19.918664 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26a8d3f-121c-4591-ba61-560c2fe664e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:19.920230 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26a8d3f-121c-4591-ba61-560c2fe664e9 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:19.931622 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 222/431] 10.222.0.70 () {56 vars in 1376 bytes} [Fri Aug 19 15:53:19 2022] GET /identity/v3/role_assignments?group.id=ee23f78826d64fc999d4841e3dbd61c6&scope.project.id=2e809a1a094b48538c004035badbc88e&role.id=09971bc698e84205be000073fc048af2 => generated 611 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:20.091772 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf006d-073d-4104-8484-77a1383a1a71 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:20.097974 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91150cb3-7e4d-4069-81d0-029040480ea1 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:20.098586 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91150cb3-7e4d-4069-81d0-029040480ea1 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:20.099059 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91150cb3-7e4d-4069-81d0-029040480ea1 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:20.105089 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 223/432] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:53:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 15:53:20.107045 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48e1d9-0f99-47cb-9cdc-54bcea65aa64 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:20.107579 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48e1d9-0f99-47cb-9cdc-54bcea65aa64 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:20.108046 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48e1d9-0f99-47cb-9cdc-54bcea65aa64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:20.127961 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-1b48e1d9-0f99-47cb-9cdc-54bcea65aa64 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:53:20.129599 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-1b48e1d9-0f99-47cb-9cdc-54bcea65aa64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:53:20.144370 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:20.159652 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37265e1-8f80-4b0b-b19f-5f236b67652c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:20.160311 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37265e1-8f80-4b0b-b19f-5f236b67652c None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:20.160592 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37265e1-8f80-4b0b-b19f-5f236b67652c None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:20.162504 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37265e1-8f80-4b0b-b19f-5f236b67652c None admin] PATH_INFO: `/v3/groups/ee23f78826d64fc999d4841e3dbd61c6` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:20.162504 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37265e1-8f80-4b0b-b19f-5f236b67652c None admin] RBAC: Authorizing `identity:get_group(group_id=ee23f78826d64fc999d4841e3dbd61c6)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:20.163570 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37265e1-8f80-4b0b-b19f-5f236b67652c None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:20.165514 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 210/433] 10.222.0.70 () {56 vars in 1180 bytes} [Fri Aug 19 15:53:19 2022] GET /identity/v3/groups/ee23f78826d64fc999d4841e3dbd61c6 => generated 226 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:20.166063 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37265e1-8f80-4b0b-b19f-5f236b67652c None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:20.172846 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:20.215472 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 224/434] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:53:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 15:53:20.216592 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b48e1d9-0f99-47cb-9cdc-54bcea65aa64 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:20.287342 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37265e1-8f80-4b0b-b19f-5f236b67652c None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:20.331262 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59329b47-5d17-4021-b57c-0bca114e178f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:20.331924 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59329b47-5d17-4021-b57c-0bca114e178f None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:20.332205 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59329b47-5d17-4021-b57c-0bca114e178f None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:20.332510 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59329b47-5d17-4021-b57c-0bca114e178f None admin] PATH_INFO: `/v3/roles/member` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:20.341680 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b48e1d9-0f99-47cb-9cdc-54bcea65aa64 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:20.354756 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59329b47-5d17-4021-b57c-0bca114e178f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:53:20.364141 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-59329b47-5d17-4021-b57c-0bca114e178f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:53:20.364141 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:20.364141 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:20.364141 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:20.364141 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:20.364141 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:20.364141 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:20.364141 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:20.364141 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:20.364141 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:20.364141 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:20.364141 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:20.364141 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:53:20.364141 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:53:20.364141 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:53:20.364141 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:53:20.365319 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:53:20.365319 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:53:20.365319 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:53:20.365319 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:53:20.365319 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:20.365319 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:20.365319 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:20.365319 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:20.365319 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:20.365319 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:20.365319 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:20.365319 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:20.365319 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:20.365319 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:20.365319 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:20.365319 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:20.366166 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:20.366166 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:20.366166 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:20.366166 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:20.366166 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:53:20.366166 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:53:20.366166 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:53:20.366166 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:53:20.366166 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:53:20.366166 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:53:20.366166 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:53:20.366166 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:53:20.366166 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 211/435] 10.222.0.70 () {56 vars in 1099 bytes} [Fri Aug 19 15:53:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:20.366834 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb527a26-5512-4b72-82cd-7199de2aeacc None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:20.367520 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb527a26-5512-4b72-82cd-7199de2aeacc None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:20.367520 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb527a26-5512-4b72-82cd-7199de2aeacc None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:20.369409 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 212/436] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:53:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:53:20.372572 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb527a26-5512-4b72-82cd-7199de2aeacc None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:20.392144 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3cd13f-9f14-47ec-a2a3-63ace83382cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:20.392776 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3cd13f-9f14-47ec-a2a3-63ace83382cf None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:20.393053 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3cd13f-9f14-47ec-a2a3-63ace83382cf None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:20.393456 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3cd13f-9f14-47ec-a2a3-63ace83382cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:20.394192 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3cd13f-9f14-47ec-a2a3-63ace83382cf None admin] RBAC: Adding query filter params (group.id=ee23f78826d64fc999d4841e3dbd61c6, role.id=294bcd6132ef46d48aff3efa4d77fa0a, scope.project.id=2e809a1a094b48538c004035badbc88e) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:20.394640 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3cd13f-9f14-47ec-a2a3-63ace83382cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:20.395929 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3cd13f-9f14-47ec-a2a3-63ace83382cf None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:20.403295 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 225/437] 10.222.0.70 () {56 vars in 1376 bytes} [Fri Aug 19 15:53:20 2022] GET /identity/v3/role_assignments?group.id=ee23f78826d64fc999d4841e3dbd61c6&scope.project.id=2e809a1a094b48538c004035badbc88e&role.id=294bcd6132ef46d48aff3efa4d77fa0a => generated 611 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:20.404537 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ec287-f102-47d7-935a-6edbcf9eed10 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:20.404911 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ec287-f102-47d7-935a-6edbcf9eed10 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:20.405190 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ec287-f102-47d7-935a-6edbcf9eed10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:20.426932 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-013ec287-f102-47d7-935a-6edbcf9eed10 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:53:20.429736 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-013ec287-f102-47d7-935a-6edbcf9eed10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:53:20.435982 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:20.475094 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:20.541490 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb527a26-5512-4b72-82cd-7199de2aeacc None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:20.547578 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 226/438] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:53:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:53:20.586763 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0e2fcb-ed11-459c-aee9-ac9dc371e751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:20.588041 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e2fcb-ed11-459c-aee9-ac9dc371e751 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:20.588320 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e2fcb-ed11-459c-aee9-ac9dc371e751 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:20.588591 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e2fcb-ed11-459c-aee9-ac9dc371e751 None admin] PATH_INFO: `/v3/roles` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:20.589307 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0e2fcb-ed11-459c-aee9-ac9dc371e751 None admin] RBAC: Adding query filter params (name=member) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:20.589607 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0e2fcb-ed11-459c-aee9-ac9dc371e751 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:20.591105 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0e2fcb-ed11-459c-aee9-ac9dc371e751 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:20.600559 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ec287-f102-47d7-935a-6edbcf9eed10 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:20.603490 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 213/439] 10.222.0.70 () {56 vars in 1101 bytes} [Fri Aug 19 15:53:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:20.610668 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0e2fcb-ed11-459c-aee9-ac9dc371e751 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:20.749194 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ec287-f102-47d7-935a-6edbcf9eed10 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:20.765864 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0e2fcb-ed11-459c-aee9-ac9dc371e751 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:20.800119 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:20.801147 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b8760-c5a9-493f-bcbe-8585e4ed41a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:20.808319 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b8760-c5a9-493f-bcbe-8585e4ed41a2 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:20.808609 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b8760-c5a9-493f-bcbe-8585e4ed41a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:20.808962 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b8760-c5a9-493f-bcbe-8585e4ed41a2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:20.811728 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d2898-abe8-4b22-bd9f-b8ba1f784682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:20.812345 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d2898-abe8-4b22-bd9f-b8ba1f784682 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:20.812620 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d2898-abe8-4b22-bd9f-b8ba1f784682 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:20.813019 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d2898-abe8-4b22-bd9f-b8ba1f784682 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:20.821081 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:20.823756 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b8760-c5a9-493f-bcbe-8585e4ed41a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:53:20.829195 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-435b8760-c5a9-493f-bcbe-8585e4ed41a2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 15:53:20.829195 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:20.829195 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:20.829195 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:20.829195 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:20.829195 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:20.829195 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:20.829195 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:20.829195 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:20.829195 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:20.829195 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:20.829195 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:20.829195 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:53:20.829195 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:53:20.829195 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:53:20.829195 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:53:20.830095 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:53:20.830095 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:53:20.830095 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:53:20.830095 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:53:20.830095 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:20.830095 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:20.830095 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:20.830095 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:20.830095 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:20.830095 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:20.830095 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:20.830095 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:20.830095 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:20.830095 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:20.830095 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:20.830095 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:20.830876 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:20.830876 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:20.830876 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:20.830876 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:20.830876 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:53:20.830876 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:53:20.830876 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:53:20.830876 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:53:20.830876 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:53:20.830876 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:53:20.830876 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 15:53:20.830876 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:20.833579 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 227/440] 10.222.0.70 () {56 vars in 1114 bytes} [Fri Aug 19 15:53:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:20.839953 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b8760-c5a9-493f-bcbe-8585e4ed41a2 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:20.903292 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9d2898-abe8-4b22-bd9f-b8ba1f784682 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:20.905288 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9d2898-abe8-4b22-bd9f-b8ba1f784682 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:20.972235 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b8760-c5a9-493f-bcbe-8585e4ed41a2 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:21.013160 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf59aec3-3d77-4a2b-a164-81620ee0e63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:21.013681 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59aec3-3d77-4a2b-a164-81620ee0e63a None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:21.013962 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59aec3-3d77-4a2b-a164-81620ee0e63a None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:21.014231 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59aec3-3d77-4a2b-a164-81620ee0e63a None admin] PATH_INFO: `/v3/roles` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:21.014890 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf59aec3-3d77-4a2b-a164-81620ee0e63a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:21.015189 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf59aec3-3d77-4a2b-a164-81620ee0e63a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:21.016570 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf59aec3-3d77-4a2b-a164-81620ee0e63a None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:21.017119 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 214/441] 10.222.0.70 () {58 vars in 1282 bytes} [Fri Aug 19 15:53:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:53:21.017953 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d2898-abe8-4b22-bd9f-b8ba1f784682 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:21.029491 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 228/442] 10.222.0.70 () {56 vars in 1111 bytes} [Fri Aug 19 15:53:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:53:21.030316 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf59aec3-3d77-4a2b-a164-81620ee0e63a None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:21.045591 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:21.095154 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:21.126264 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d2898-abe8-4b22-bd9f-b8ba1f784682 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:21.140255 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf59aec3-3d77-4a2b-a164-81620ee0e63a None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:21.164218 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb876959-7d4b-45b5-93cb-7c6af994ce11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:21.164893 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb876959-7d4b-45b5-93cb-7c6af994ce11 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:21.165167 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb876959-7d4b-45b5-93cb-7c6af994ce11 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:21.165959 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb876959-7d4b-45b5-93cb-7c6af994ce11 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:21.176117 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb876959-7d4b-45b5-93cb-7c6af994ce11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:53:21.177857 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7848ef-1bbe-415d-b037-06c0afa85bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:21.178487 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7848ef-1bbe-415d-b037-06c0afa85bfb None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:21.178768 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7848ef-1bbe-415d-b037-06c0afa85bfb None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:21.179039 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7848ef-1bbe-415d-b037-06c0afa85bfb None admin] PATH_INFO: `/v3/projects/8299174a2d574620a12d3d2e42f01c55` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:21.180159 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7848ef-1bbe-415d-b037-06c0afa85bfb None admin] RBAC: Authorizing `identity:get_project(project_id=8299174a2d574620a12d3d2e42f01c55)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:21.180976 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-eb876959-7d4b-45b5-93cb-7c6af994ce11 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:53:21.180976 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:21.180976 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:21.180976 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:21.180976 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:21.180976 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:21.180976 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:21.180976 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:21.180976 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:21.180976 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:21.180976 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:21.180976 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:21.180976 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:53:21.180976 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:53:21.180976 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:53:21.180976 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:53:21.182297 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:53:21.182297 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:53:21.182297 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:53:21.182297 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:53:21.182297 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:21.182297 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:21.182297 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:21.182297 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:21.182297 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:21.182297 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:21.182297 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:21.182297 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:21.182297 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:21.182297 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:21.182297 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:21.182297 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:21.183073 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:21.183073 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:21.183073 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:21.183073 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:21.183073 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:53:21.183073 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:53:21.183073 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:53:21.183073 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:53:21.183073 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:53:21.183073 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:53:21.183073 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:53:21.183073 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:53:21.183673 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7848ef-1bbe-415d-b037-06c0afa85bfb None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:21.184369 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 215/443] 10.222.0.70 () {56 vars in 1096 bytes} [Fri Aug 19 15:53:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:21.184369 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb876959-7d4b-45b5-93cb-7c6af994ce11 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:21.184633 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 229/444] 10.222.0.70 () {56 vars in 1186 bytes} [Fri Aug 19 15:53:21 2022] GET /identity/v3/projects/8299174a2d574620a12d3d2e42f01c55 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:21.190392 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7848ef-1bbe-415d-b037-06c0afa85bfb None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:21.279130 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:21.293689 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb876959-7d4b-45b5-93cb-7c6af994ce11 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:21.295104 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7848ef-1bbe-415d-b037-06c0afa85bfb None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:21.326527 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:21.330226 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab24169-8ce7-4f05-8d50-d005b85eefe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:21.330833 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab24169-8ce7-4f05-8d50-d005b85eefe4 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:21.331108 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab24169-8ce7-4f05-8d50-d005b85eefe4 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:21.331380 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab24169-8ce7-4f05-8d50-d005b85eefe4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:21.335271 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2da16f-8bc4-4345-84e0-0a53579c15f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:21.335899 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2da16f-8bc4-4345-84e0-0a53579c15f0 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:21.336167 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2da16f-8bc4-4345-84e0-0a53579c15f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:21.336432 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2da16f-8bc4-4345-84e0-0a53579c15f0 None admin] PATH_INFO: `/v3/roles` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:21.337220 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2da16f-8bc4-4345-84e0-0a53579c15f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:21.338042 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2da16f-8bc4-4345-84e0-0a53579c15f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:21.339610 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2da16f-8bc4-4345-84e0-0a53579c15f0 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:21.350646 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 230/445] 10.222.0.70 () {56 vars in 1099 bytes} [Fri Aug 19 15:53:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:53:21.354984 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2da16f-8bc4-4345-84e0-0a53579c15f0 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:21.413110 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab24169-8ce7-4f05-8d50-d005b85eefe4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:21.414589 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab24169-8ce7-4f05-8d50-d005b85eefe4 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:21.452581 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2da16f-8bc4-4345-84e0-0a53579c15f0 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:21.487817 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea7202-3854-4f24-ada0-ea66dcccc34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:21.488443 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea7202-3854-4f24-ada0-ea66dcccc34d None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:21.488750 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea7202-3854-4f24-ada0-ea66dcccc34d None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:21.489029 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea7202-3854-4f24-ada0-ea66dcccc34d None admin] PATH_INFO: `/v3/groups/ee23f78826d64fc999d4841e3dbd61c6` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:21.490195 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea7202-3854-4f24-ada0-ea66dcccc34d None admin] RBAC: Authorizing `identity:get_group(group_id=ee23f78826d64fc999d4841e3dbd61c6)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:21.491629 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea7202-3854-4f24-ada0-ea66dcccc34d None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:21.493280 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 231/446] 10.222.0.70 () {56 vars in 1180 bytes} [Fri Aug 19 15:53:21 2022] GET /identity/v3/groups/ee23f78826d64fc999d4841e3dbd61c6 => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:21.494069 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea7202-3854-4f24-ada0-ea66dcccc34d None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:21.500353 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:21.517022 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 216/447] 10.222.0.70 () {58 vars in 1282 bytes} [Fri Aug 19 15:53:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:53:21.518209 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab24169-8ce7-4f05-8d50-d005b85eefe4 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:21.560172 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:21.602530 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea7202-3854-4f24-ada0-ea66dcccc34d None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:21.621732 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab24169-8ce7-4f05-8d50-d005b85eefe4 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:21.637348 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f6999b-e8e1-4c42-bbd8-ae2b5af98f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:21.637955 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6999b-e8e1-4c42-bbd8-ae2b5af98f96 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:21.638233 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6999b-e8e1-4c42-bbd8-ae2b5af98f96 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:21.638506 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6999b-e8e1-4c42-bbd8-ae2b5af98f96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:21.655902 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f99f9e-cba7-4f32-be53-73001b4aa3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:21.656498 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f99f9e-cba7-4f32-be53-73001b4aa3d7 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:21.656808 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f99f9e-cba7-4f32-be53-73001b4aa3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:21.657085 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f99f9e-cba7-4f32-be53-73001b4aa3d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:21.657797 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f99f9e-cba7-4f32-be53-73001b4aa3d7 None admin] RBAC: Adding query filter params (group.id=ee23f78826d64fc999d4841e3dbd61c6, role.id=09971bc698e84205be000073fc048af2, scope.project.id=8299174a2d574620a12d3d2e42f01c55) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:21.658102 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f99f9e-cba7-4f32-be53-73001b4aa3d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:21.659522 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f99f9e-cba7-4f32-be53-73001b4aa3d7 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:21.666107 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 217/448] 10.222.0.70 () {56 vars in 1376 bytes} [Fri Aug 19 15:53:21 2022] GET /identity/v3/role_assignments?group.id=ee23f78826d64fc999d4841e3dbd61c6&scope.project.id=8299174a2d574620a12d3d2e42f01c55&role.id=09971bc698e84205be000073fc048af2 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:21.666768 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f99f9e-cba7-4f32-be53-73001b4aa3d7 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:21.721544 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:21.738032 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f6999b-e8e1-4c42-bbd8-ae2b5af98f96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:21.739605 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f6999b-e8e1-4c42-bbd8-ae2b5af98f96 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:21.783033 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f99f9e-cba7-4f32-be53-73001b4aa3d7 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:21.810317 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:21.827110 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae23cd0-1635-457b-b2dd-41f596cef115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:21.828138 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae23cd0-1635-457b-b2dd-41f596cef115 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:21.828638 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae23cd0-1635-457b-b2dd-41f596cef115 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:21.829157 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae23cd0-1635-457b-b2dd-41f596cef115 None admin] PATH_INFO: `/v3/projects/8299174a2d574620a12d3d2e42f01c55` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:21.830447 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae23cd0-1635-457b-b2dd-41f596cef115 None admin] RBAC: Authorizing `identity:get_project(project_id=8299174a2d574620a12d3d2e42f01c55)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:21.831913 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae23cd0-1635-457b-b2dd-41f596cef115 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:21.833653 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 218/449] 10.222.0.70 () {56 vars in 1186 bytes} [Fri Aug 19 15:53:21 2022] GET /identity/v3/projects/8299174a2d574620a12d3d2e42f01c55 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:21.840182 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae23cd0-1635-457b-b2dd-41f596cef115 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:21.861787 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 232/450] 10.222.0.70 () {58 vars in 1282 bytes} [Fri Aug 19 15:53:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:53:21.869062 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f6999b-e8e1-4c42-bbd8-ae2b5af98f96 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:21.981705 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae23cd0-1635-457b-b2dd-41f596cef115 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:22.000695 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f6999b-e8e1-4c42-bbd8-ae2b5af98f96 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:22.005421 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:22.032733 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d18d58-4e34-479e-bd5f-fd6b2396d24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:22.033780 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d18d58-4e34-479e-bd5f-fd6b2396d24c None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:22.033780 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d18d58-4e34-479e-bd5f-fd6b2396d24c None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:22.033983 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d18d58-4e34-479e-bd5f-fd6b2396d24c None admin] PATH_INFO: `/v3/groups/ee23f78826d64fc999d4841e3dbd61c6` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:22.035168 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d18d58-4e34-479e-bd5f-fd6b2396d24c None admin] RBAC: Authorizing `identity:get_group(group_id=ee23f78826d64fc999d4841e3dbd61c6)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:22.036616 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d18d58-4e34-479e-bd5f-fd6b2396d24c None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:22.038281 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 219/451] 10.222.0.70 () {56 vars in 1180 bytes} [Fri Aug 19 15:53:21 2022] GET /identity/v3/groups/ee23f78826d64fc999d4841e3dbd61c6 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:53:22.044928 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d18d58-4e34-479e-bd5f-fd6b2396d24c None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:22.054087 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef500c5e-554a-41ee-a2f9-81282f27554b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:22.054728 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef500c5e-554a-41ee-a2f9-81282f27554b None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:22.055484 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef500c5e-554a-41ee-a2f9-81282f27554b None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:22.055484 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef500c5e-554a-41ee-a2f9-81282f27554b None admin] PATH_INFO: `/v3/projects/e72646e5274546c7b7216d7348ce3bc4` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:22.057667 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef500c5e-554a-41ee-a2f9-81282f27554b None admin] RBAC: Authorizing `identity:get_project(project_id=e72646e5274546c7b7216d7348ce3bc4)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:22.059096 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef500c5e-554a-41ee-a2f9-81282f27554b None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:22.064877 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 233/452] 10.222.0.70 () {56 vars in 1186 bytes} [Fri Aug 19 15:53:21 2022] GET /identity/v3/projects/e72646e5274546c7b7216d7348ce3bc4 => generated 344 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:53:22.066881 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef500c5e-554a-41ee-a2f9-81282f27554b None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:22.104383 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:22.166475 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d18d58-4e34-479e-bd5f-fd6b2396d24c None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:22.178372 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef500c5e-554a-41ee-a2f9-81282f27554b None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:22.202842 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24b53d-747d-4c1c-b62c-4de5ad0a9b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:22.203442 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24b53d-747d-4c1c-b62c-4de5ad0a9b6d None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:22.203722 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24b53d-747d-4c1c-b62c-4de5ad0a9b6d None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:22.203990 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24b53d-747d-4c1c-b62c-4de5ad0a9b6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:22.204730 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e24b53d-747d-4c1c-b62c-4de5ad0a9b6d None admin] RBAC: Adding query filter params (group.id=ee23f78826d64fc999d4841e3dbd61c6, role.id=294bcd6132ef46d48aff3efa4d77fa0a, scope.project.id=8299174a2d574620a12d3d2e42f01c55) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:22.205036 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e24b53d-747d-4c1c-b62c-4de5ad0a9b6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:22.206475 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e24b53d-747d-4c1c-b62c-4de5ad0a9b6d None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:22.212845 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 220/453] 10.222.0.70 () {56 vars in 1376 bytes} [Fri Aug 19 15:53:22 2022] GET /identity/v3/role_assignments?group.id=ee23f78826d64fc999d4841e3dbd61c6&scope.project.id=8299174a2d574620a12d3d2e42f01c55&role.id=294bcd6132ef46d48aff3efa4d77fa0a => generated 611 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:53:22.216837 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a34fb1-934a-4a94-abc3-dd31d8dd1ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:22.217564 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a34fb1-934a-4a94-abc3-dd31d8dd1ea4 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:22.217914 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a34fb1-934a-4a94-abc3-dd31d8dd1ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:22.218254 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a34fb1-934a-4a94-abc3-dd31d8dd1ea4 None admin] PATH_INFO: `/v3/groups/1c3738e11394483dbeb328c00cf9f692` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:22.219521 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a34fb1-934a-4a94-abc3-dd31d8dd1ea4 None admin] RBAC: Authorizing `identity:get_group(group_id=1c3738e11394483dbeb328c00cf9f692)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:22.221128 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a34fb1-934a-4a94-abc3-dd31d8dd1ea4 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:22.222929 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 234/454] 10.222.0.70 () {56 vars in 1180 bytes} [Fri Aug 19 15:53:22 2022] GET /identity/v3/groups/1c3738e11394483dbeb328c00cf9f692 => generated 229 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:53:22.229801 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24b53d-747d-4c1c-b62c-4de5ad0a9b6d None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:22.285729 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:22.342206 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24b53d-747d-4c1c-b62c-4de5ad0a9b6d None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:22.381664 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b863b0-3e03-490f-a843-3ee2426cb727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:22.382283 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b863b0-3e03-490f-a843-3ee2426cb727 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:22.382559 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b863b0-3e03-490f-a843-3ee2426cb727 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:22.382908 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b863b0-3e03-490f-a843-3ee2426cb727 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:22.383775 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b863b0-3e03-490f-a843-3ee2426cb727 None admin] RBAC: Adding query filter params (group.id=1c3738e11394483dbeb328c00cf9f692, role.id=2f6cb7d6ec874879972a12a63d61068d, scope.project.id=e72646e5274546c7b7216d7348ce3bc4) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:22.384125 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b863b0-3e03-490f-a843-3ee2426cb727 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:22.385804 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b863b0-3e03-490f-a843-3ee2426cb727 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:22.392599 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 221/455] 10.222.0.70 () {56 vars in 1376 bytes} [Fri Aug 19 15:53:22 2022] GET /identity/v3/role_assignments?group.id=1c3738e11394483dbeb328c00cf9f692&scope.project.id=e72646e5274546c7b7216d7348ce3bc4&role.id=2f6cb7d6ec874879972a12a63d61068d => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:24.987948 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568fbe0-3471-494e-bcfa-612c86ce1fee None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:24.988541 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568fbe0-3471-494e-bcfa-612c86ce1fee None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:24.988541 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568fbe0-3471-494e-bcfa-612c86ce1fee None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:24.990296 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 235/456] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:53:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:53:24.996400 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d29e48-2884-4776-acfd-dbcde21cf017 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:24.996923 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d29e48-2884-4776-acfd-dbcde21cf017 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:24.997008 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d29e48-2884-4776-acfd-dbcde21cf017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:25.016253 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-a7d29e48-2884-4776-acfd-dbcde21cf017 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:53:25.017484 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-a7d29e48-2884-4776-acfd-dbcde21cf017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:53:25.101870 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 222/457] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:53:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 15:53:25.247222 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc18acd-4edf-4174-ae93-c6229daf8f55 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:25.247955 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc18acd-4edf-4174-ae93-c6229daf8f55 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:25.248434 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc18acd-4edf-4174-ae93-c6229daf8f55 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:25.250359 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 236/458] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:53:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:53:25.256183 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e720d5fb-714f-46c0-b683-fd743c07c856 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:25.256823 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e720d5fb-714f-46c0-b683-fd743c07c856 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:25.257311 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e720d5fb-714f-46c0-b683-fd743c07c856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:25.277881 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-e720d5fb-714f-46c0-b683-fd743c07c856 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:53:25.279411 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-e720d5fb-714f-46c0-b683-fd743c07c856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:53:25.325885 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:25.360914 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be874615-ff0e-491a-9703-92fb6f8d28ad None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:25.361255 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be874615-ff0e-491a-9703-92fb6f8d28ad None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:25.361464 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be874615-ff0e-491a-9703-92fb6f8d28ad None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:25.376877 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 237/459] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:53:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:53:25.376877 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af1367-7765-4ebb-91cc-70c9a4544bc5 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:25.376877 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af1367-7765-4ebb-91cc-70c9a4544bc5 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:25.376877 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af1367-7765-4ebb-91cc-70c9a4544bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:25.377221 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 223/460] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:53:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:53:25.391369 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-94af1367-7765-4ebb-91cc-70c9a4544bc5 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:53:25.392595 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-94af1367-7765-4ebb-91cc-70c9a4544bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:53:25.443619 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e720d5fb-714f-46c0-b683-fd743c07c856 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:25.472172 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 238/461] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:53:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:53:25.566410 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e720d5fb-714f-46c0-b683-fd743c07c856 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:25.602896 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb444b-5571-4b91-8f3b-a97d44c42f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:25.603570 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb444b-5571-4b91-8f3b-a97d44c42f2b None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:25.603839 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb444b-5571-4b91-8f3b-a97d44c42f2b None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:25.604203 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb444b-5571-4b91-8f3b-a97d44c42f2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:25.615189 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb444b-5571-4b91-8f3b-a97d44c42f2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:25.616644 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb444b-5571-4b91-8f3b-a97d44c42f2b None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:25.629593 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ebdae1-abad-4e78-ba39-8089f5b931b0 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:25.629922 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ebdae1-abad-4e78-ba39-8089f5b931b0 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:25.630123 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ebdae1-abad-4e78-ba39-8089f5b931b0 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:25.631704 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 239/462] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:53:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 15:53:25.633795 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-68bb444b-5571-4b91-8f3b-a97d44c42f2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:25.633795 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:25.633795 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:25.633795 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:25.633795 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:25.633795 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:25.633795 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:25.633795 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:25.633795 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:25.633795 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:25.633795 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:25.633795 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:25.633795 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:53:25.633795 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:53:25.633795 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:53:25.633795 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:53:25.634777 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:25.634777 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:25.634777 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:25.634777 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:25.634777 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:25.634777 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:25.634777 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:25.634777 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:25.634777 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:25.634777 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:25.634777 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:25.634777 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:25.634777 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:25.634777 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:25.634777 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:25.634777 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:25.634777 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:53:25.636919 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:53:25.636919 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:25.636919 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:53:25.636919 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 224/463] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:53:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:53:25.637516 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebb055-52e0-416d-b6ba-c67953c5dbbb None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:25.637793 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebb055-52e0-416d-b6ba-c67953c5dbbb None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:25.638063 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebb055-52e0-416d-b6ba-c67953c5dbbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:25.643876 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb444b-5571-4b91-8f3b-a97d44c42f2b None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:25.656910 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-c6ebb055-52e0-416d-b6ba-c67953c5dbbb None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:53:25.658120 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-c6ebb055-52e0-416d-b6ba-c67953c5dbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:53:25.679365 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:25.679787 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:25.736982 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 240/464] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:53:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:53:25.737775 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ebb055-52e0-416d-b6ba-c67953c5dbbb None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:25.807099 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb444b-5571-4b91-8f3b-a97d44c42f2b None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:25.870971 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a7d663-2af6-45b9-9da5-56c2b2a370ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:25.871488 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7d663-2af6-45b9-9da5-56c2b2a370ee None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:25.871836 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7d663-2af6-45b9-9da5-56c2b2a370ee None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:25.872036 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7d663-2af6-45b9-9da5-56c2b2a370ee None admin] PATH_INFO: `/v3/domains` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:25.872705 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a7d663-2af6-45b9-9da5-56c2b2a370ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:25.872981 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a7d663-2af6-45b9-9da5-56c2b2a370ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:25.874346 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a7d663-2af6-45b9-9da5-56c2b2a370ee None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:25.875960 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ebb055-52e0-416d-b6ba-c67953c5dbbb None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:25.892895 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 225/465] 10.222.0.70 () {56 vars in 1109 bytes} [Fri Aug 19 15:53:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:53:25.892895 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a7d663-2af6-45b9-9da5-56c2b2a370ee None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:25.923844 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb701ed0-cc7c-4a7a-8124-649055cd4bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:25.924485 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb701ed0-cc7c-4a7a-8124-649055cd4bdb None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:25.924796 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb701ed0-cc7c-4a7a-8124-649055cd4bdb None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:25.925063 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb701ed0-cc7c-4a7a-8124-649055cd4bdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:25.942651 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb701ed0-cc7c-4a7a-8124-649055cd4bdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:25.942651 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb701ed0-cc7c-4a7a-8124-649055cd4bdb None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:25.958273 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-cb701ed0-cc7c-4a7a-8124-649055cd4bdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:25.958273 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:25.958273 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:25.958273 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:25.958273 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:25.958273 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:25.958273 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:25.958273 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:25.958273 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:25.958273 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:25.958273 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:25.958273 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:25.958273 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:53:25.958273 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:53:25.958273 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:53:25.958273 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:53:25.959251 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:25.959251 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:25.959251 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:25.959251 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:25.959251 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:25.959251 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:25.959251 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:25.959251 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:25.959251 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:25.959251 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:25.959251 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:25.959251 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:25.959251 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:25.959251 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:25.959251 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:25.959251 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:25.959251 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:53:25.960098 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:53:25.960098 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:25.960098 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:25.960098 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 241/466] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:53:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:25.960818 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb701ed0-cc7c-4a7a-8124-649055cd4bdb None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:25.974027 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:26.009510 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:26.026469 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a7d663-2af6-45b9-9da5-56c2b2a370ee None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:26.068027 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ddc6ba-d3d5-49a6-a6c4-abd54fd05914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:26.068767 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ddc6ba-d3d5-49a6-a6c4-abd54fd05914 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:26.068972 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ddc6ba-d3d5-49a6-a6c4-abd54fd05914 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:26.069244 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ddc6ba-d3d5-49a6-a6c4-abd54fd05914 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:26.082775 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb701ed0-cc7c-4a7a-8124-649055cd4bdb None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:26.084802 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ddc6ba-d3d5-49a6-a6c4-abd54fd05914 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:26.086375 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ddc6ba-d3d5-49a6-a6c4-abd54fd05914 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:26.102148 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-28ddc6ba-d3d5-49a6-a6c4-abd54fd05914 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:26.102148 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:26.102148 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:26.102148 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:26.102148 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:26.102148 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:26.102148 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:26.102148 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:26.102148 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:26.102148 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:26.102148 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:26.102148 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:26.102148 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:53:26.102148 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:53:26.102148 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:53:26.102148 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:53:26.103122 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:26.103122 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:26.103122 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:26.103122 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:26.103122 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:26.103122 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:26.103122 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:26.103122 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:26.103122 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:26.103122 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:26.103122 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:26.103122 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:26.103122 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:26.103122 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:26.103122 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:26.103122 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:26.103122 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:53:26.104586 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:53:26.104586 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:26.104586 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:53:26.104586 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 226/467] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:53:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:26.105185 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ddc6ba-d3d5-49a6-a6c4-abd54fd05914 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:26.121273 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f370f73d-d799-4c24-8718-d515c8fe23ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:26.121798 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370f73d-d799-4c24-8718-d515c8fe23ae None admin] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:26.122074 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370f73d-d799-4c24-8718-d515c8fe23ae None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:26.122345 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370f73d-d799-4c24-8718-d515c8fe23ae None admin] PATH_INFO: `/v3/users` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:26.122982 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f370f73d-d799-4c24-8718-d515c8fe23ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:26.124436 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f370f73d-d799-4c24-8718-d515c8fe23ae None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:26.211040 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ddc6ba-d3d5-49a6-a6c4-abd54fd05914 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:26.220350 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 242/468] 10.222.0.70 () {60 vars in 1132 bytes} [Fri Aug 19 15:53:25 2022] POST /identity/v3/users => generated 246 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:53:26.221324 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f370f73d-d799-4c24-8718-d515c8fe23ae None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:26.268209 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1443fe1-d538-4715-88de-fb202e34db35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:26.269020 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1443fe1-d538-4715-88de-fb202e34db35 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:26.269295 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1443fe1-d538-4715-88de-fb202e34db35 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:26.269568 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1443fe1-d538-4715-88de-fb202e34db35 None admin] PATH_INFO: `/v3/domains` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:26.270282 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1443fe1-d538-4715-88de-fb202e34db35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:26.270591 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1443fe1-d538-4715-88de-fb202e34db35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:26.272241 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1443fe1-d538-4715-88de-fb202e34db35 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:26.282841 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:26.290150 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 227/469] 10.222.0.70 () {56 vars in 1109 bytes} [Fri Aug 19 15:53:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:26.292267 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1443fe1-d538-4715-88de-fb202e34db35 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:26.317508 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:26.367286 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f370f73d-d799-4c24-8718-d515c8fe23ae None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:26.413231 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70325fe1-bc09-4b90-a696-eae490129637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:26.413794 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70325fe1-bc09-4b90-a696-eae490129637 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:26.414243 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70325fe1-bc09-4b90-a696-eae490129637 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:26.417344 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70325fe1-bc09-4b90-a696-eae490129637 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:26.421459 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1443fe1-d538-4715-88de-fb202e34db35 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:26.435947 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70325fe1-bc09-4b90-a696-eae490129637 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:26.437770 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70325fe1-bc09-4b90-a696-eae490129637 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:26.456440 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-70325fe1-bc09-4b90-a696-eae490129637 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:26.456440 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:26.456440 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:26.456440 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:26.456440 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:26.456440 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:26.456440 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:26.456440 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:26.456440 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:26.456440 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:26.456440 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:26.456440 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:26.456440 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:53:26.456440 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:53:26.456440 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:53:26.456440 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:53:26.457640 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:26.457640 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:26.457640 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:26.457640 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:26.457640 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:26.457640 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:26.457640 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:26.457640 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:26.457640 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:26.457640 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:26.457640 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:26.457640 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:26.457640 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:26.457640 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:26.457640 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:26.457640 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:26.457640 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:53:26.459023 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:53:26.459023 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:26.459023 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:26.459023 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 243/470] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:53:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:26.459023 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70325fe1-bc09-4b90-a696-eae490129637 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:26.469623 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27094d11-8bd5-4d81-9443-4b36e1f100da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:26.470682 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27094d11-8bd5-4d81-9443-4b36e1f100da None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:26.471113 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27094d11-8bd5-4d81-9443-4b36e1f100da None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:26.471539 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27094d11-8bd5-4d81-9443-4b36e1f100da None admin] PATH_INFO: `/v3/domains` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:26.472885 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27094d11-8bd5-4d81-9443-4b36e1f100da None admin] RBAC: Adding query filter params (name=Default) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:26.474056 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27094d11-8bd5-4d81-9443-4b36e1f100da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:26.477152 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27094d11-8bd5-4d81-9443-4b36e1f100da None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:26.490754 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 228/471] 10.222.0.70 () {56 vars in 1109 bytes} [Fri Aug 19 15:53:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:26.491604 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27094d11-8bd5-4d81-9443-4b36e1f100da None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:26.565052 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:26.586040 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70325fe1-bc09-4b90-a696-eae490129637 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:26.605615 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:26.612042 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27094d11-8bd5-4d81-9443-4b36e1f100da None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:26.624769 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d691b-4a84-45f6-bf24-2128c79661ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:26.625382 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d691b-4a84-45f6-bf24-2128c79661ff None admin] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:26.625660 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d691b-4a84-45f6-bf24-2128c79661ff None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:26.625935 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d691b-4a84-45f6-bf24-2128c79661ff None admin] PATH_INFO: `/v3/users` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:26.626575 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d691b-4a84-45f6-bf24-2128c79661ff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:26.628521 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d691b-4a84-45f6-bf24-2128c79661ff None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:26.652698 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b35dff-c5c7-4c15-bb72-de94e421a5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:26.653309 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b35dff-c5c7-4c15-bb72-de94e421a5b3 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:26.653583 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b35dff-c5c7-4c15-bb72-de94e421a5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:26.653855 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b35dff-c5c7-4c15-bb72-de94e421a5b3 None admin] PATH_INFO: `/v3/domains` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:26.654561 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b35dff-c5c7-4c15-bb72-de94e421a5b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:26.654856 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b35dff-c5c7-4c15-bb72-de94e421a5b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:26.656252 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b35dff-c5c7-4c15-bb72-de94e421a5b3 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:26.669739 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 229/472] 10.222.0.70 () {56 vars in 1109 bytes} [Fri Aug 19 15:53:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:26.670554 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b35dff-c5c7-4c15-bb72-de94e421a5b3 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:26.740700 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 244/473] 10.222.0.70 () {60 vars in 1132 bytes} [Fri Aug 19 15:53:26 2022] POST /identity/v3/users => generated 248 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:53:26.740700 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d691b-4a84-45f6-bf24-2128c79661ff None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:26.801261 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b35dff-c5c7-4c15-bb72-de94e421a5b3 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:26.827746 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:26.848926 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5924ad2d-9fd2-4ee2-a9dc-a79bd5f16641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:26.850992 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924ad2d-9fd2-4ee2-a9dc-a79bd5f16641 None admin] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:26.851665 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924ad2d-9fd2-4ee2-a9dc-a79bd5f16641 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:26.852014 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924ad2d-9fd2-4ee2-a9dc-a79bd5f16641 None admin] PATH_INFO: `/v3/users` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:26.852991 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5924ad2d-9fd2-4ee2-a9dc-a79bd5f16641 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:26.856174 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5924ad2d-9fd2-4ee2-a9dc-a79bd5f16641 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:26.900027 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d691b-4a84-45f6-bf24-2128c79661ff None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:26.945959 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926626ca-f280-4a69-85af-21fd449fe945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:26.946495 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926626ca-f280-4a69-85af-21fd449fe945 None admin] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:26.946837 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926626ca-f280-4a69-85af-21fd449fe945 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:26.947365 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926626ca-f280-4a69-85af-21fd449fe945 None admin] PATH_INFO: `/v3/users` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:26.948881 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926626ca-f280-4a69-85af-21fd449fe945 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:26.952955 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926626ca-f280-4a69-85af-21fd449fe945 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:26.989316 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 230/474] 10.222.0.70 () {60 vars in 1132 bytes} [Fri Aug 19 15:53:26 2022] POST /identity/v3/users => generated 248 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:53:27.055934 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 245/475] 10.222.0.70 () {60 vars in 1132 bytes} [Fri Aug 19 15:53:26 2022] POST /identity/v3/users => generated 249 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:53:28.581859 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73040747-bd48-4e18-badd-87294758c00c None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:28.582863 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73040747-bd48-4e18-badd-87294758c00c None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:28.583535 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73040747-bd48-4e18-badd-87294758c00c None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:28.585424 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 231/476] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:53:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:53:28.591948 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d143a7c-714b-42ea-bf6c-498a5605649c None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:28.592935 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d143a7c-714b-42ea-bf6c-498a5605649c None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:28.593432 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d143a7c-714b-42ea-bf6c-498a5605649c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:28.614153 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-5d143a7c-714b-42ea-bf6c-498a5605649c None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:53:28.615892 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-5d143a7c-714b-42ea-bf6c-498a5605649c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:53:28.641710 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:28.694467 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 246/477] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:53:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:53:29.026168 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73040747-bd48-4e18-badd-87294758c00c None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:29.162675 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73040747-bd48-4e18-badd-87294758c00c None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:29.205508 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99c0f48-328e-4c85-86ff-8dfb37d7f1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:29.206417 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c0f48-328e-4c85-86ff-8dfb37d7f1d3 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:29.206871 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c0f48-328e-4c85-86ff-8dfb37d7f1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:29.207285 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c0f48-328e-4c85-86ff-8dfb37d7f1d3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:29.220547 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99c0f48-328e-4c85-86ff-8dfb37d7f1d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:53:29.226289 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-c99c0f48-328e-4c85-86ff-8dfb37d7f1d3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:53:29.226289 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:29.226289 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:29.226289 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:29.226289 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:29.226289 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:29.226289 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:29.226289 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:29.226289 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:29.226289 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:29.226289 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:29.226289 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:29.226289 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:53:29.226289 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:53:29.226289 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:53:29.226289 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:53:29.227424 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:53:29.227424 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:53:29.227424 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:53:29.227424 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:53:29.227424 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:29.227424 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:29.227424 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:29.227424 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:29.227424 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:29.227424 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:29.227424 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:29.227424 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:29.227424 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:29.227424 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:29.227424 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:29.227424 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:29.228370 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:29.228370 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:29.228370 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:29.228370 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:29.228370 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:53:29.228370 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:53:29.228370 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:53:29.228370 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:53:29.228370 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:53:29.228370 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:53:29.228370 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:53:29.228370 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:53:29.231272 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 232/478] 10.222.0.70 () {56 vars in 1102 bytes} [Fri Aug 19 15:53:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:29.237244 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d143a7c-714b-42ea-bf6c-498a5605649c None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:29.273983 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d765084-e2fd-4baf-b3be-bae386f1ab75 None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:29.274559 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d765084-e2fd-4baf-b3be-bae386f1ab75 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:29.274985 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d765084-e2fd-4baf-b3be-bae386f1ab75 None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:29.278246 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 233/479] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:53:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:53:29.284092 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff33a52-4f6b-499a-81a9-d16d72db465d None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:29.284620 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff33a52-4f6b-499a-81a9-d16d72db465d None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:29.285087 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff33a52-4f6b-499a-81a9-d16d72db465d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:29.305678 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-aff33a52-4f6b-499a-81a9-d16d72db465d None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:53:29.308155 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-aff33a52-4f6b-499a-81a9-d16d72db465d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:53:29.355021 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:29.355240 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d143a7c-714b-42ea-bf6c-498a5605649c None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:29.396834 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bd7ad3-6e9a-430d-9009-1613f1aee9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:29.397509 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd7ad3-6e9a-430d-9009-1613f1aee9ff None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:29.397792 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd7ad3-6e9a-430d-9009-1613f1aee9ff None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:29.398067 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd7ad3-6e9a-430d-9009-1613f1aee9ff None admin] PATH_INFO: `/v3/roles` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:29.398853 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bd7ad3-6e9a-430d-9009-1613f1aee9ff None admin] RBAC: Adding query filter params (name=service) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:29.399427 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bd7ad3-6e9a-430d-9009-1613f1aee9ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:29.401681 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bd7ad3-6e9a-430d-9009-1613f1aee9ff None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:29.408711 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 234/480] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:53:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:53:29.408711 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b33ae-4abc-4729-9ceb-25eba2c03866 None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:29.408711 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b33ae-4abc-4729-9ceb-25eba2c03866 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:29.408711 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b33ae-4abc-4729-9ceb-25eba2c03866 None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:29.408711 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 235/481] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:53:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:53:29.412455 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d20905-bfe9-4803-bbda-da8679a24e41 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:29.412776 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d20905-bfe9-4803-bbda-da8679a24e41 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:29.413075 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d20905-bfe9-4803-bbda-da8679a24e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:29.419180 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 247/482] 10.222.0.70 () {56 vars in 1103 bytes} [Fri Aug 19 15:53:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:29.425226 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bd7ad3-6e9a-430d-9009-1613f1aee9ff None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:29.436465 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-40d20905-bfe9-4803-bbda-da8679a24e41 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:53:29.437714 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-40d20905-bfe9-4803-bbda-da8679a24e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:53:29.455183 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:29.513275 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 236/483] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:53:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 15:53:29.514716 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be89fa-af5e-4c01-823b-d920e70c19ae None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:29.515000 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be89fa-af5e-4c01-823b-d920e70c19ae None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:29.515269 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be89fa-af5e-4c01-823b-d920e70c19ae None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:29.516726 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 237/484] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:53:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:53:29.522383 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e6892-228c-41ca-8f2e-16d3a8dc2c7f None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:29.522817 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e6892-228c-41ca-8f2e-16d3a8dc2c7f None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:29.524120 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e6892-228c-41ca-8f2e-16d3a8dc2c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:29.548755 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-b28e6892-228c-41ca-8f2e-16d3a8dc2c7f None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:53:29.550672 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-b28e6892-228c-41ca-8f2e-16d3a8dc2c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:53:29.561675 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bd7ad3-6e9a-430d-9009-1613f1aee9ff None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:29.602190 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661ab93a-4eba-45c4-a038-cfaaf63b0e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:29.603665 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ab93a-4eba-45c4-a038-cfaaf63b0e07 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:29.604226 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ab93a-4eba-45c4-a038-cfaaf63b0e07 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:29.604722 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ab93a-4eba-45c4-a038-cfaaf63b0e07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:29.617332 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661ab93a-4eba-45c4-a038-cfaaf63b0e07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:29.619363 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661ab93a-4eba-45c4-a038-cfaaf63b0e07 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:29.639029 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-661ab93a-4eba-45c4-a038-cfaaf63b0e07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:29.639029 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:29.639029 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:29.639029 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:29.639029 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:29.639029 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:29.639029 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:29.639029 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:29.639029 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:29.639029 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:29.639029 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:29.639029 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:29.639029 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:53:29.639029 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:53:29.639029 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:53:29.639029 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:53:29.640015 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:29.640015 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:29.640015 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:29.640015 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:29.640015 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:29.640015 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:29.640015 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:29.640015 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:29.640015 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:29.640015 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:29.640015 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:29.640015 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:29.640015 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:29.640015 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:29.640015 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:29.640015 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:29.640015 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:53:29.641551 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:53:29.641551 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:29.641551 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:29.648368 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 238/485] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:53:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:53:29.649268 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 248/486] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:53:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:29.649703 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28e6892-228c-41ca-8f2e-16d3a8dc2c7f None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:29.676486 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:29.753372 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661ab93a-4eba-45c4-a038-cfaaf63b0e07 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:29.757355 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28e6892-228c-41ca-8f2e-16d3a8dc2c7f None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:29.802981 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a83c801-641e-4958-842c-3a4c4fa18427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:29.803565 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a83c801-641e-4958-842c-3a4c4fa18427 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:29.803842 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a83c801-641e-4958-842c-3a4c4fa18427 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:29.804151 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a83c801-641e-4958-842c-3a4c4fa18427 None admin] PATH_INFO: `/v3/domains` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:29.805353 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a83c801-641e-4958-842c-3a4c4fa18427 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:29.805656 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a83c801-641e-4958-842c-3a4c4fa18427 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:29.808128 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a83c801-641e-4958-842c-3a4c4fa18427 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:29.823717 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 239/487] 10.222.0.70 () {56 vars in 1109 bytes} [Fri Aug 19 15:53:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:29.830618 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a83c801-641e-4958-842c-3a4c4fa18427 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:29.847612 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:29.896375 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661ab93a-4eba-45c4-a038-cfaaf63b0e07 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:29.937051 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b0216-0219-4e1f-ab17-ce18b58959e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:29.937647 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b0216-0219-4e1f-ab17-ce18b58959e9 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:29.937927 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b0216-0219-4e1f-ab17-ce18b58959e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:29.938209 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b0216-0219-4e1f-ab17-ce18b58959e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:29.943383 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:29.953650 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749b0216-0219-4e1f-ab17-ce18b58959e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:53:29.958948 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-749b0216-0219-4e1f-ab17-ce18b58959e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:53:29.958948 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:29.958948 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:29.958948 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:29.958948 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:29.958948 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:29.958948 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:29.958948 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:29.958948 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:29.958948 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:29.958948 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:29.958948 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:29.958948 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:53:29.958948 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:53:29.958948 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:53:29.958948 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:53:29.959995 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:53:29.959995 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:53:29.959995 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:53:29.959995 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:53:29.959995 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:29.959995 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:29.959995 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:29.959995 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:29.959995 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:29.959995 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:29.959995 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:29.959995 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:29.959995 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:29.959995 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:29.959995 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:29.959995 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:29.965820 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:29.965820 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:29.965820 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:29.965820 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:29.965820 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:53:29.965820 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:53:29.965820 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:53:29.965820 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:53:29.965820 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:53:29.965820 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:53:29.965820 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:53:29.965820 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:29.966414 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a83c801-641e-4958-842c-3a4c4fa18427 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:29.966486 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 249/488] 10.222.0.70 () {56 vars in 1102 bytes} [Fri Aug 19 15:53:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:29.966486 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b0216-0219-4e1f-ab17-ce18b58959e9 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:30.003104 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacff816-95ef-40ae-bee8-83a047625528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:30.003736 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacff816-95ef-40ae-bee8-83a047625528 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:30.004108 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacff816-95ef-40ae-bee8-83a047625528 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:30.004275 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacff816-95ef-40ae-bee8-83a047625528 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:30.012337 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacff816-95ef-40ae-bee8-83a047625528 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:30.013849 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacff816-95ef-40ae-bee8-83a047625528 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:30.028643 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-aacff816-95ef-40ae-bee8-83a047625528 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 15:53:30.028643 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:30.028643 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:30.028643 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:30.028643 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:30.028643 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:30.028643 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:30.028643 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:30.028643 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:30.028643 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:30.028643 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:30.028643 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:30.028643 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 15:53:30.028643 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 15:53:30.028643 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 15:53:30.028643 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 15:53:30.029627 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:30.029627 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:30.029627 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 15:53:30.029627 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:53:30.029627 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 15:53:30.029627 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:53:30.029627 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:30.029627 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:30.029627 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:30.029627 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:30.029627 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:30.029627 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:30.029627 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:30.029627 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:30.029627 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:30.029627 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:30.029627 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:30.029627 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:30.030569 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:30.030569 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:30.030569 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 15:53:30.030569 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 15:53:30.030569 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 15:53:30.030569 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 15:53:30.030569 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 15:53:30.030569 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 15:53:30.030569 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 15:53:30.030569 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:53:30.030569 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 240/489] 10.222.0.70 () {56 vars in 1093 bytes} [Fri Aug 19 15:53:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:30.031148 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacff816-95ef-40ae-bee8-83a047625528 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:30.081622 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b0216-0219-4e1f-ab17-ce18b58959e9 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:30.112926 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:30.118037 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46220ad-6e23-4a2d-a39d-fe4c1ee25fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:30.118664 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46220ad-6e23-4a2d-a39d-fe4c1ee25fab None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:30.118939 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46220ad-6e23-4a2d-a39d-fe4c1ee25fab None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:30.119774 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46220ad-6e23-4a2d-a39d-fe4c1ee25fab None admin] PATH_INFO: `/v3/roles/service` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:30.131187 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46220ad-6e23-4a2d-a39d-fe4c1ee25fab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:53:30.137088 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacff816-95ef-40ae-bee8-83a047625528 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:30.137438 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-a46220ad-6e23-4a2d-a39d-fe4c1ee25fab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:53:30.137438 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:30.137438 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:30.137438 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:30.137438 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:30.137438 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:30.137438 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:30.137438 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:30.137438 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:30.137438 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:30.137438 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:30.137438 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:30.137438 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:53:30.137438 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:53:30.137438 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:53:30.137438 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:53:30.138474 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:53:30.138474 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:53:30.138474 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:53:30.138474 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:53:30.138474 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:30.138474 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:30.138474 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:30.138474 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:30.138474 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:30.138474 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:30.138474 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:30.138474 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:30.138474 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:30.138474 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:30.138474 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:30.138474 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:30.139467 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:30.139467 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:30.139467 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:30.139467 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:30.139467 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:53:30.139467 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:53:30.139467 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:53:30.139467 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:53:30.139467 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:53:30.139467 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:53:30.139467 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:53:30.139467 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:30.139467 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 250/490] 10.222.0.70 () {56 vars in 1102 bytes} [Fri Aug 19 15:53:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:30.140654 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46220ad-6e23-4a2d-a39d-fe4c1ee25fab None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:30.175867 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a38d1b-6f15-40cf-a5c9-1c7da2a57f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:30.176515 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a38d1b-6f15-40cf-a5c9-1c7da2a57f9b None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:30.176770 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a38d1b-6f15-40cf-a5c9-1c7da2a57f9b None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:30.177040 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a38d1b-6f15-40cf-a5c9-1c7da2a57f9b None admin] PATH_INFO: `/v3/roles` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:30.177700 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a38d1b-6f15-40cf-a5c9-1c7da2a57f9b None admin] RBAC: Adding query filter params (name=service) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:30.177997 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a38d1b-6f15-40cf-a5c9-1c7da2a57f9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:30.179363 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a38d1b-6f15-40cf-a5c9-1c7da2a57f9b None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:30.188432 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 241/491] 10.222.0.70 () {56 vars in 1103 bytes} [Fri Aug 19 15:53:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:30.189290 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a38d1b-6f15-40cf-a5c9-1c7da2a57f9b None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:30.199208 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:30.249047 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46220ad-6e23-4a2d-a39d-fe4c1ee25fab None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:30.283570 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ae666-4b54-4c48-8950-9cb5c8c7861f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:30.284198 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ae666-4b54-4c48-8950-9cb5c8c7861f None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:30.284468 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ae666-4b54-4c48-8950-9cb5c8c7861f None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:30.284765 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ae666-4b54-4c48-8950-9cb5c8c7861f None admin] PATH_INFO: `/v3/roles/service` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:30.295880 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300ae666-4b54-4c48-8950-9cb5c8c7861f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:53:30.297218 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a38d1b-6f15-40cf-a5c9-1c7da2a57f9b None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:30.300756 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-300ae666-4b54-4c48-8950-9cb5c8c7861f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:53:30.300756 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:30.300756 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:30.300756 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:30.300756 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:30.300756 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:30.300756 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:30.300756 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:30.300756 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:30.300756 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:30.300756 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:30.300756 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:30.300756 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:53:30.300756 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:53:30.300756 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:53:30.300756 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:53:30.301641 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:53:30.301641 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:53:30.301641 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:53:30.301641 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:53:30.301641 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:30.301641 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:30.301641 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:30.301641 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:30.301641 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:30.301641 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:30.301641 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:30.301641 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:30.301641 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:30.301641 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:30.301641 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:30.301641 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:30.302421 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:30.302421 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:30.302421 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:30.302421 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:30.302421 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:53:30.302421 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:53:30.302421 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:53:30.302421 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:53:30.302421 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:53:30.302421 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:53:30.302421 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:53:30.302421 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:30.302421 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 251/492] 10.222.0.70 () {56 vars in 1102 bytes} [Fri Aug 19 15:53:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:30.303068 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ae666-4b54-4c48-8950-9cb5c8c7861f None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:30.335875 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca7a4d-3fae-4a33-82f6-07a8c34f4e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:30.336501 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca7a4d-3fae-4a33-82f6-07a8c34f4e58 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:30.336805 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca7a4d-3fae-4a33-82f6-07a8c34f4e58 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:30.337079 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca7a4d-3fae-4a33-82f6-07a8c34f4e58 None admin] PATH_INFO: `/v3/users` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:30.337865 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ca7a4d-3fae-4a33-82f6-07a8c34f4e58 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:30.338339 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ca7a4d-3fae-4a33-82f6-07a8c34f4e58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:30.339997 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ca7a4d-3fae-4a33-82f6-07a8c34f4e58 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:30.361073 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:30.380127 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 242/493] 10.222.0.70 () {56 vars in 1133 bytes} [Fri Aug 19 15:53:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:30.381026 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca7a4d-3fae-4a33-82f6-07a8c34f4e58 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:30.416699 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ae666-4b54-4c48-8950-9cb5c8c7861f None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:30.451708 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:30.453742 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e8c50-90bb-46d5-b851-92084f467c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:30.454354 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e8c50-90bb-46d5-b851-92084f467c53 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:30.454634 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e8c50-90bb-46d5-b851-92084f467c53 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:30.454906 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e8c50-90bb-46d5-b851-92084f467c53 None admin] PATH_INFO: `/v3/roles` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:30.455571 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12e8c50-90bb-46d5-b851-92084f467c53 None admin] RBAC: Adding query filter params (name=service) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:30.455871 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12e8c50-90bb-46d5-b851-92084f467c53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:30.457315 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12e8c50-90bb-46d5-b851-92084f467c53 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:30.466038 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 252/494] 10.222.0.70 () {56 vars in 1103 bytes} [Fri Aug 19 15:53:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:30.466790 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e8c50-90bb-46d5-b851-92084f467c53 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:30.493220 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca7a4d-3fae-4a33-82f6-07a8c34f4e58 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:30.530133 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4714a8bc-02d8-4ebb-9693-ea5feb07a90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:30.530765 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714a8bc-02d8-4ebb-9693-ea5feb07a90f None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:30.531039 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714a8bc-02d8-4ebb-9693-ea5feb07a90f None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:30.531306 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714a8bc-02d8-4ebb-9693-ea5feb07a90f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:30.543186 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4714a8bc-02d8-4ebb-9693-ea5feb07a90f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:30.544776 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4714a8bc-02d8-4ebb-9693-ea5feb07a90f None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:30.562433 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-4714a8bc-02d8-4ebb-9693-ea5feb07a90f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:30.562433 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:30.562433 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:30.562433 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:30.562433 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:30.562433 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:30.562433 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:30.562433 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:30.562433 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:30.562433 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:30.562433 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:30.562433 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:30.562433 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:53:30.562433 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:53:30.562433 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:53:30.562433 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:53:30.563464 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:30.563464 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:30.563464 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:30.563464 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:30.563464 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:30.563464 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:30.563464 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:30.563464 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:30.563464 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:30.563464 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:30.563464 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:30.563464 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:30.563464 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:30.563464 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:30.563464 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:30.563464 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:30.563464 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:53:30.564432 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:53:30.564432 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:30.564432 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:53:30.564432 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 243/495] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:53:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:30.564432 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4714a8bc-02d8-4ebb-9693-ea5feb07a90f None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:30.584047 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e8c50-90bb-46d5-b851-92084f467c53 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:30.599188 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:30.620481 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896763cb-87c1-4429-a434-a9ca99a9bf9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:30.621162 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896763cb-87c1-4429-a434-a9ca99a9bf9f None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:30.621380 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896763cb-87c1-4429-a434-a9ca99a9bf9f None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:30.621645 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896763cb-87c1-4429-a434-a9ca99a9bf9f None admin] PATH_INFO: `/v3/roles` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:30.622305 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896763cb-87c1-4429-a434-a9ca99a9bf9f None admin] RBAC: Adding query filter params (name=service) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:30.622600 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896763cb-87c1-4429-a434-a9ca99a9bf9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:30.623974 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896763cb-87c1-4429-a434-a9ca99a9bf9f None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:30.632948 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 253/496] 10.222.0.70 () {56 vars in 1103 bytes} [Fri Aug 19 15:53:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:30.633764 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896763cb-87c1-4429-a434-a9ca99a9bf9f None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:30.675683 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4714a8bc-02d8-4ebb-9693-ea5feb07a90f None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:30.692915 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:30.714827 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09a081-cc46-43c3-b381-c01bac8ae8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:30.715438 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09a081-cc46-43c3-b381-c01bac8ae8f5 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:30.715753 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09a081-cc46-43c3-b381-c01bac8ae8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:30.716035 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09a081-cc46-43c3-b381-c01bac8ae8f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:30.743503 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896763cb-87c1-4429-a434-a9ca99a9bf9f None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:30.782804 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9918956-019d-4a5c-aa42-5266d394279d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:30.783437 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9918956-019d-4a5c-aa42-5266d394279d None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:30.783717 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9918956-019d-4a5c-aa42-5266d394279d None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:30.783989 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9918956-019d-4a5c-aa42-5266d394279d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:30.788463 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf09a081-cc46-43c3-b381-c01bac8ae8f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:30.789985 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf09a081-cc46-43c3-b381-c01bac8ae8f5 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:30.796017 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9918956-019d-4a5c-aa42-5266d394279d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:30.798680 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9918956-019d-4a5c-aa42-5266d394279d None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:30.813187 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-e9918956-019d-4a5c-aa42-5266d394279d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:30.813187 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:30.813187 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:30.813187 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:30.813187 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:30.813187 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:30.813187 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:30.813187 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:30.813187 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:30.813187 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:30.813187 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:30.813187 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:30.813187 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:53:30.813187 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:53:30.813187 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:53:30.813187 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:53:30.814192 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:30.814192 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:30.814192 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:30.814192 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:30.814192 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:30.814192 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:30.814192 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:30.814192 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:30.814192 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:30.814192 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:30.814192 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:30.814192 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:30.814192 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:30.814192 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:30.814192 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:30.814192 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:30.814192 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:53:30.815038 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:53:30.815038 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:30.815038 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:30.815038 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 254/497] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:53:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:30.815038 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9918956-019d-4a5c-aa42-5266d394279d None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:30.845059 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:30.903428 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 244/498] 10.222.0.70 () {58 vars in 1282 bytes} [Fri Aug 19 15:53:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:53:30.904098 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09a081-cc46-43c3-b381-c01bac8ae8f5 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:30.925237 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:30.929701 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9918956-019d-4a5c-aa42-5266d394279d None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:30.969325 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8a7633-66f2-4c65-b879-7bdf1503e404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:30.969919 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a7633-66f2-4c65-b879-7bdf1503e404 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:30.970195 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a7633-66f2-4c65-b879-7bdf1503e404 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:30.970602 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a7633-66f2-4c65-b879-7bdf1503e404 None admin] PATH_INFO: `/v3/domains` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:30.971144 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8a7633-66f2-4c65-b879-7bdf1503e404 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:30.971440 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8a7633-66f2-4c65-b879-7bdf1503e404 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:30.972917 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8a7633-66f2-4c65-b879-7bdf1503e404 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:30.992318 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 255/499] 10.222.0.70 () {56 vars in 1109 bytes} [Fri Aug 19 15:53:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:30.993576 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8a7633-66f2-4c65-b879-7bdf1503e404 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:31.015877 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09a081-cc46-43c3-b381-c01bac8ae8f5 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:31.057932 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df06636c-c1e6-4ede-aad0-9bbe8c3ef6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:31.058607 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06636c-c1e6-4ede-aad0-9bbe8c3ef6d0 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:31.058927 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06636c-c1e6-4ede-aad0-9bbe8c3ef6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:31.059212 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06636c-c1e6-4ede-aad0-9bbe8c3ef6d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:31.070945 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df06636c-c1e6-4ede-aad0-9bbe8c3ef6d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:31.072983 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df06636c-c1e6-4ede-aad0-9bbe8c3ef6d0 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:31.089340 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:31.089603 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-df06636c-c1e6-4ede-aad0-9bbe8c3ef6d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:31.089603 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:31.089603 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:31.089603 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:31.089603 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:31.089603 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:31.089603 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:31.089603 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:31.089603 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:31.089603 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:31.089603 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:31.089603 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:31.089603 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:53:31.089603 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:53:31.089603 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:53:31.089603 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:53:31.090471 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:31.090471 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:31.090471 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:31.090471 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:31.090471 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:31.090471 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:31.090471 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:31.090471 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:31.090471 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:31.090471 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:31.090471 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:31.090471 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:31.090471 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:31.090471 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:31.090471 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:31.090471 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:31.090471 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:53:31.091314 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:53:31.091314 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:31.091314 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:53:31.091314 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 245/500] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:53:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:31.091891 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df06636c-c1e6-4ede-aad0-9bbe8c3ef6d0 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:31.105781 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8a7633-66f2-4c65-b879-7bdf1503e404 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:31.143476 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366fa31c-e160-4760-92f6-5784997386a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:31.144081 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366fa31c-e160-4760-92f6-5784997386a3 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:31.144352 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366fa31c-e160-4760-92f6-5784997386a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:31.144616 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366fa31c-e160-4760-92f6-5784997386a3 None admin] PATH_INFO: `/v3/domains` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:31.145292 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366fa31c-e160-4760-92f6-5784997386a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:31.145586 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366fa31c-e160-4760-92f6-5784997386a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:31.146953 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366fa31c-e160-4760-92f6-5784997386a3 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:31.159264 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 256/501] 10.222.0.70 () {56 vars in 1109 bytes} [Fri Aug 19 15:53:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:31.160017 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366fa31c-e160-4760-92f6-5784997386a3 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:31.166896 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:31.207884 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df06636c-c1e6-4ede-aad0-9bbe8c3ef6d0 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:31.242460 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a10922-32c5-4f14-aa2a-b889ad8ae0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:31.243096 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a10922-32c5-4f14-aa2a-b889ad8ae0dd None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:31.243370 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a10922-32c5-4f14-aa2a-b889ad8ae0dd None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:31.243649 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a10922-32c5-4f14-aa2a-b889ad8ae0dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:31.256362 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a10922-32c5-4f14-aa2a-b889ad8ae0dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:31.257988 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a10922-32c5-4f14-aa2a-b889ad8ae0dd None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:31.271539 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366fa31c-e160-4760-92f6-5784997386a3 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:31.277402 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-b9a10922-32c5-4f14-aa2a-b889ad8ae0dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:31.277402 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:31.277402 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:31.277402 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:31.277402 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:31.277402 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:31.277402 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:31.277402 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:31.277402 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:31.277402 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:31.277402 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:31.277402 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:31.277402 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:53:31.277402 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:53:31.277402 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:53:31.277402 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:53:31.278330 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:31.278330 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:31.278330 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:31.278330 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:31.278330 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:31.278330 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:31.278330 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:31.278330 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:31.278330 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:31.278330 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:31.278330 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:31.278330 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:31.278330 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:31.278330 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:31.278330 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:31.278330 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:31.278330 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:53:31.279236 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:53:31.279236 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:31.279236 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:53:31.279236 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 246/502] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:53:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:31.279480 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a10922-32c5-4f14-aa2a-b889ad8ae0dd None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:31.315461 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4022af-1ac3-4d48-a707-c0d6b709709a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:31.316090 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4022af-1ac3-4d48-a707-c0d6b709709a None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:31.316359 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4022af-1ac3-4d48-a707-c0d6b709709a None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:31.316633 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4022af-1ac3-4d48-a707-c0d6b709709a None admin] PATH_INFO: `/v3/users/glance` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:31.325804 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4022af-1ac3-4d48-a707-c0d6b709709a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:31.327263 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4022af-1ac3-4d48-a707-c0d6b709709a None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:31.341058 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-9a4022af-1ac3-4d48-a707-c0d6b709709a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 19 15:53:31.341058 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:31.341058 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:31.341058 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:31.341058 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:31.341058 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:31.341058 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:31.341058 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:31.341058 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:31.341058 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:31.341058 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:31.341058 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:31.341058 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 15:53:31.341058 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 15:53:31.341058 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 15:53:31.341058 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 15:53:31.349850 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:31.349850 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:31.349850 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 15:53:31.349850 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:53:31.349850 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 15:53:31.349850 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:53:31.349850 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:31.349850 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:31.349850 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:31.349850 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:31.349850 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:31.349850 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:31.349850 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:31.349850 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:31.349850 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:31.349850 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:31.349850 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:31.349850 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:31.350991 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:31.350991 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:31.350991 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 15:53:31.350991 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 15:53:31.350991 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 15:53:31.350991 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 15:53:31.350991 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 15:53:31.350991 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 15:53:31.350991 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 19 15:53:31.350991 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:31.350991 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 257/503] 10.222.0.70 () {56 vars in 1099 bytes} [Fri Aug 19 15:53:31 2022] GET /identity/v3/users/glance => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:31.350991 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4022af-1ac3-4d48-a707-c0d6b709709a None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:31.363533 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:31.394759 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a10922-32c5-4f14-aa2a-b889ad8ae0dd None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:31.417865 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:31.437071 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067e4ea3-e501-4ee9-946e-33b93f7213a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:31.437683 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e4ea3-e501-4ee9-946e-33b93f7213a8 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:31.437963 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e4ea3-e501-4ee9-946e-33b93f7213a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:31.438240 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e4ea3-e501-4ee9-946e-33b93f7213a8 None admin] PATH_INFO: `/v3/domains` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:31.438989 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067e4ea3-e501-4ee9-946e-33b93f7213a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:31.439302 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067e4ea3-e501-4ee9-946e-33b93f7213a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:31.440740 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067e4ea3-e501-4ee9-946e-33b93f7213a8 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:31.454720 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 247/504] 10.222.0.70 () {56 vars in 1109 bytes} [Fri Aug 19 15:53:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:31.455573 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067e4ea3-e501-4ee9-946e-33b93f7213a8 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:31.458368 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4022af-1ac3-4d48-a707-c0d6b709709a None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:31.497006 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9007aca-c795-4785-99bf-33434e6202d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:31.497633 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9007aca-c795-4785-99bf-33434e6202d6 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:31.497912 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9007aca-c795-4785-99bf-33434e6202d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:31.498185 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9007aca-c795-4785-99bf-33434e6202d6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:31.506240 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9007aca-c795-4785-99bf-33434e6202d6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:31.507703 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9007aca-c795-4785-99bf-33434e6202d6 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:31.519820 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-f9007aca-c795-4785-99bf-33434e6202d6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 15:53:31.519820 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:31.519820 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:31.519820 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:31.519820 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:31.519820 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:31.519820 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:31.519820 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:31.519820 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:31.519820 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:31.519820 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:31.519820 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:31.519820 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 15:53:31.519820 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 15:53:31.519820 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 15:53:31.519820 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 15:53:31.520907 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:31.520907 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:31.520907 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 15:53:31.520907 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:53:31.520907 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 15:53:31.520907 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:53:31.520907 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:31.520907 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:31.520907 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:31.520907 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:31.520907 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:31.520907 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:31.520907 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:31.520907 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:31.520907 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:31.520907 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:31.520907 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:31.520907 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:31.521804 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:31.521804 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:31.521804 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 15:53:31.521804 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 15:53:31.521804 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 15:53:31.521804 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 15:53:31.521804 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 15:53:31.521804 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 15:53:31.521804 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 15:53:31.521804 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:31.521804 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 258/505] 10.222.0.70 () {56 vars in 1099 bytes} [Fri Aug 19 15:53:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:31.521804 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9007aca-c795-4785-99bf-33434e6202d6 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:31.566268 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067e4ea3-e501-4ee9-946e-33b93f7213a8 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:31.595306 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:31.602658 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14218b6e-9b16-4e88-9b30-9f0b9aabe77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:31.603265 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14218b6e-9b16-4e88-9b30-9f0b9aabe77b None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:31.604273 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14218b6e-9b16-4e88-9b30-9f0b9aabe77b None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:31.604805 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14218b6e-9b16-4e88-9b30-9f0b9aabe77b None admin] PATH_INFO: `/v3/domains` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:31.605525 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14218b6e-9b16-4e88-9b30-9f0b9aabe77b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:31.611950 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14218b6e-9b16-4e88-9b30-9f0b9aabe77b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:31.611950 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14218b6e-9b16-4e88-9b30-9f0b9aabe77b None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:31.618875 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 248/506] 10.222.0.70 () {56 vars in 1109 bytes} [Fri Aug 19 15:53:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:31.620199 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14218b6e-9b16-4e88-9b30-9f0b9aabe77b None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:31.634709 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9007aca-c795-4785-99bf-33434e6202d6 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:31.670073 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:31.671348 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df80d6f7-4d79-491d-aa9c-bdd57edcbdd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:31.671960 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80d6f7-4d79-491d-aa9c-bdd57edcbdd1 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:31.672238 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80d6f7-4d79-491d-aa9c-bdd57edcbdd1 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:31.672551 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80d6f7-4d79-491d-aa9c-bdd57edcbdd1 None admin] PATH_INFO: `/v3/users` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:31.673323 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df80d6f7-4d79-491d-aa9c-bdd57edcbdd1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:31.673628 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df80d6f7-4d79-491d-aa9c-bdd57edcbdd1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:31.675083 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df80d6f7-4d79-491d-aa9c-bdd57edcbdd1 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:31.714338 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 259/507] 10.222.0.70 () {56 vars in 1137 bytes} [Fri Aug 19 15:53:31 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:31.715206 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df80d6f7-4d79-491d-aa9c-bdd57edcbdd1 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:31.742323 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14218b6e-9b16-4e88-9b30-9f0b9aabe77b None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:31.779560 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff42ce9-6323-4970-8db3-485065965d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:31.780622 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff42ce9-6323-4970-8db3-485065965d29 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:31.780622 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff42ce9-6323-4970-8db3-485065965d29 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:31.780854 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff42ce9-6323-4970-8db3-485065965d29 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:31.788715 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff42ce9-6323-4970-8db3-485065965d29 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:31.790170 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff42ce9-6323-4970-8db3-485065965d29 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:31.803564 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-2ff42ce9-6323-4970-8db3-485065965d29 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 15:53:31.803564 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:31.803564 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:31.803564 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:31.803564 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:31.803564 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:31.803564 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:31.803564 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:31.803564 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:31.803564 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:31.803564 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:31.803564 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:31.803564 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 15:53:31.803564 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 15:53:31.803564 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 15:53:31.803564 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 15:53:31.804745 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:31.804745 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:31.804745 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 15:53:31.804745 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:53:31.804745 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 15:53:31.804745 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:53:31.804745 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:31.804745 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:31.804745 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:31.804745 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:31.804745 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:31.804745 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:31.804745 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:31.804745 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:31.804745 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:31.804745 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:31.804745 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:31.804745 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:31.810594 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:31.810594 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:31.810594 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 15:53:31.810594 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 15:53:31.810594 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 15:53:31.810594 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 15:53:31.810594 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 15:53:31.810594 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 15:53:31.810594 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 15:53:31.810594 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:53:31.810594 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 249/508] 10.222.0.70 () {56 vars in 1102 bytes} [Fri Aug 19 15:53:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:31.810594 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff42ce9-6323-4970-8db3-485065965d29 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:31.837530 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df80d6f7-4d79-491d-aa9c-bdd57edcbdd1 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:31.867580 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:31.879925 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1932358d-7d64-45fe-ace4-808cbc812a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:31.880768 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932358d-7d64-45fe-ace4-808cbc812a0e None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:31.880870 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932358d-7d64-45fe-ace4-808cbc812a0e None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:31.881135 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932358d-7d64-45fe-ace4-808cbc812a0e None admin] PATH_INFO: `/v3/users` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:31.881861 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1932358d-7d64-45fe-ace4-808cbc812a0e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:31.882159 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1932358d-7d64-45fe-ace4-808cbc812a0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:31.883613 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1932358d-7d64-45fe-ace4-808cbc812a0e None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:31.903630 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 260/509] 10.222.0.70 () {56 vars in 1137 bytes} [Fri Aug 19 15:53:31 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:31.904477 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1932358d-7d64-45fe-ace4-808cbc812a0e None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:31.915841 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:31.920159 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff42ce9-6323-4970-8db3-485065965d29 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:31.956344 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b8295-6a13-4f54-aae4-7dec733da7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:31.957013 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b8295-6a13-4f54-aae4-7dec733da7b3 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:31.957293 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b8295-6a13-4f54-aae4-7dec733da7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:31.957572 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b8295-6a13-4f54-aae4-7dec733da7b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:31.965783 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651b8295-6a13-4f54-aae4-7dec733da7b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:31.967257 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651b8295-6a13-4f54-aae4-7dec733da7b3 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:31.980468 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-651b8295-6a13-4f54-aae4-7dec733da7b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:53:31.980468 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:31.980468 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:31.980468 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:31.980468 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:31.980468 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:31.980468 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:31.980468 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:31.980468 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:31.980468 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:31.980468 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:31.980468 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:31.980468 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 15:53:31.980468 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 15:53:31.980468 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 15:53:31.981521 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 15:53:31.981521 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:31.981521 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:31.981521 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:31.981521 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:31.981521 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:31.981521 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:31.981521 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:31.981521 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:31.981521 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:31.981521 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:31.981521 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:31.981521 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:31.981521 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:31.981521 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:31.981521 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:31.981521 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:31.982388 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 15:53:31.982388 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 15:53:31.982388 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 15:53:31.982388 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 15:53:31.982388 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 15:53:31.982388 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 15:53:31.982388 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:53:31.982388 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:53:31.982388 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 250/510] 10.222.0.70 () {56 vars in 1111 bytes} [Fri Aug 19 15:53:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:31.982893 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b8295-6a13-4f54-aae4-7dec733da7b3 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:32.024865 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1932358d-7d64-45fe-ace4-808cbc812a0e None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:32.062613 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90edad94-5c23-470b-a601-c07656a98450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:32.063215 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90edad94-5c23-470b-a601-c07656a98450 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:32.063545 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90edad94-5c23-470b-a601-c07656a98450 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:32.063760 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90edad94-5c23-470b-a601-c07656a98450 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:32.089582 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b8295-6a13-4f54-aae4-7dec733da7b3 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:32.126092 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:32.127074 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce8887-7a32-41c1-8db1-45ada4f906c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:32.127881 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce8887-7a32-41c1-8db1-45ada4f906c0 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:32.128153 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce8887-7a32-41c1-8db1-45ada4f906c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:32.128417 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce8887-7a32-41c1-8db1-45ada4f906c0 None admin] PATH_INFO: `/v3/users` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:32.129179 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ce8887-7a32-41c1-8db1-45ada4f906c0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:32.129480 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ce8887-7a32-41c1-8db1-45ada4f906c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:32.130912 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ce8887-7a32-41c1-8db1-45ada4f906c0 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:32.144750 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90edad94-5c23-470b-a601-c07656a98450 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:32.146245 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90edad94-5c23-470b-a601-c07656a98450 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:32.149542 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 251/511] 10.222.0.70 () {56 vars in 1139 bytes} [Fri Aug 19 15:53:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:32.151216 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce8887-7a32-41c1-8db1-45ada4f906c0 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:32.173082 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:32.260970 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce8887-7a32-41c1-8db1-45ada4f906c0 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:32.261610 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 261/512] 10.222.0.70 () {58 vars in 1282 bytes} [Fri Aug 19 15:53:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:53:32.262469 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90edad94-5c23-470b-a601-c07656a98450 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:32.313097 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf8d28-7184-46a6-8b8b-aad3195dd80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:32.313718 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf8d28-7184-46a6-8b8b-aad3195dd80b None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:32.313995 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf8d28-7184-46a6-8b8b-aad3195dd80b None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:32.314266 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf8d28-7184-46a6-8b8b-aad3195dd80b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:32.361861 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:32.379249 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90edad94-5c23-470b-a601-c07656a98450 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:32.392700 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbf8d28-7184-46a6-8b8b-aad3195dd80b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:32.394225 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbf8d28-7184-46a6-8b8b-aad3195dd80b None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:32.413090 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:32.418538 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fff9b-1d4d-4904-a403-968377670acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:32.419139 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fff9b-1d4d-4904-a403-968377670acb None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:32.419410 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fff9b-1d4d-4904-a403-968377670acb None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:32.419676 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fff9b-1d4d-4904-a403-968377670acb None admin] PATH_INFO: `/v3/projects` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:32.420362 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04fff9b-1d4d-4904-a403-968377670acb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:32.420655 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04fff9b-1d4d-4904-a403-968377670acb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:32.422123 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04fff9b-1d4d-4904-a403-968377670acb None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:32.441531 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 262/513] 10.222.0.70 () {56 vars in 1148 bytes} [Fri Aug 19 15:53:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:32.445267 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fff9b-1d4d-4904-a403-968377670acb None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:32.506619 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 252/514] 10.222.0.70 () {58 vars in 1282 bytes} [Fri Aug 19 15:53:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:53:32.507476 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf8d28-7184-46a6-8b8b-aad3195dd80b None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:32.562435 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fff9b-1d4d-4904-a403-968377670acb None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:32.599709 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a84a62-3435-4640-8262-440c98c5c85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:32.600309 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a84a62-3435-4640-8262-440c98c5c85b None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:32.600584 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a84a62-3435-4640-8262-440c98c5c85b None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:32.600945 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a84a62-3435-4640-8262-440c98c5c85b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:32.611931 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf8d28-7184-46a6-8b8b-aad3195dd80b None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:32.617042 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:32.631186 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:32.649461 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32efff2-f850-4bc0-90d7-c86aa89ed8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:32.650387 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32efff2-f850-4bc0-90d7-c86aa89ed8fb None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:32.650690 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32efff2-f850-4bc0-90d7-c86aa89ed8fb None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:32.651120 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32efff2-f850-4bc0-90d7-c86aa89ed8fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:32.662301 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32efff2-f850-4bc0-90d7-c86aa89ed8fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:32.663764 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32efff2-f850-4bc0-90d7-c86aa89ed8fb None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:32.678424 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a84a62-3435-4640-8262-440c98c5c85b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:32.679987 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a84a62-3435-4640-8262-440c98c5c85b None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:32.680482 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-a32efff2-f850-4bc0-90d7-c86aa89ed8fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:32.680482 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:32.680482 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:32.680482 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:32.680482 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:32.680482 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:32.680482 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:32.680482 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:32.680482 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:32.680482 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:32.680482 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:32.680482 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:32.680482 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:53:32.680482 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:53:32.680482 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:53:32.680482 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:53:32.681372 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:32.681372 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:32.681372 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:32.681372 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:32.681372 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:32.681372 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:32.681372 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:32.681372 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:32.681372 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:32.681372 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:32.681372 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:32.681372 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:32.681372 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:32.681372 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:32.681372 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:32.681372 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:32.681372 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:53:32.687830 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:53:32.687830 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:32.687830 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:53:32.687830 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 253/515] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:53:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:32.687830 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32efff2-f850-4bc0-90d7-c86aa89ed8fb None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:32.803820 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32efff2-f850-4bc0-90d7-c86aa89ed8fb None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:32.804488 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 263/516] 10.222.0.70 () {58 vars in 1282 bytes} [Fri Aug 19 15:53:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:53:32.805193 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a84a62-3435-4640-8262-440c98c5c85b None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:32.841843 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab13de-5f5e-496a-81d0-68a6409db79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:32.842448 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab13de-5f5e-496a-81d0-68a6409db79d None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:32.842728 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab13de-5f5e-496a-81d0-68a6409db79d None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:32.843001 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab13de-5f5e-496a-81d0-68a6409db79d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:32.843732 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab13de-5f5e-496a-81d0-68a6409db79d None admin] RBAC: Adding query filter params (role.id=f082292a9c404c30891116a86c08becd, scope.project.id=48fb7e21c6864d30b70ffca9093afec8, user.id=d90cec9e3ff64b5aa4cc867895b996ad) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:32.844039 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab13de-5f5e-496a-81d0-68a6409db79d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:32.846293 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab13de-5f5e-496a-81d0-68a6409db79d None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:32.851318 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 254/517] 10.222.0.70 () {56 vars in 1374 bytes} [Fri Aug 19 15:53:32 2022] GET /identity/v3/role_assignments?user.id=d90cec9e3ff64b5aa4cc867895b996ad&scope.project.id=48fb7e21c6864d30b70ffca9093afec8&role.id=f082292a9c404c30891116a86c08becd => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:32.852151 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab13de-5f5e-496a-81d0-68a6409db79d None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:32.864158 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:32.903315 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:32.925173 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a84a62-3435-4640-8262-440c98c5c85b None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:32.971512 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57098bc7-5830-4c51-b117-0fe9323d86db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:32.972158 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57098bc7-5830-4c51-b117-0fe9323d86db None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:32.972434 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57098bc7-5830-4c51-b117-0fe9323d86db None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:32.972734 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57098bc7-5830-4c51-b117-0fe9323d86db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:32.987538 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57098bc7-5830-4c51-b117-0fe9323d86db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:32.989071 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57098bc7-5830-4c51-b117-0fe9323d86db None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:32.989194 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab13de-5f5e-496a-81d0-68a6409db79d None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:33.007994 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-57098bc7-5830-4c51-b117-0fe9323d86db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:33.007994 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:33.007994 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:33.007994 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:33.007994 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:33.007994 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:33.007994 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:33.007994 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:33.007994 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:33.007994 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:33.007994 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:33.007994 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:33.007994 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:53:33.007994 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:53:33.007994 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:53:33.007994 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:53:33.009274 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:33.009274 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:33.009274 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:33.009274 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:33.009274 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:33.009274 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:33.009274 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:33.009274 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:33.009274 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:33.009274 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:33.009274 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:33.009274 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:33.009274 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:33.009274 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:33.009274 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:33.009274 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:33.009274 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:53:33.011000 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:53:33.011000 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:33.011000 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:33.011000 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 264/518] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:53:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:33.011000 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57098bc7-5830-4c51-b117-0fe9323d86db None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:33.057142 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f09a11-8c08-4c3f-bec0-70ce37e131b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:33.057142 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f09a11-8c08-4c3f-bec0-70ce37e131b9 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:33.057142 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f09a11-8c08-4c3f-bec0-70ce37e131b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:33.057142 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f09a11-8c08-4c3f-bec0-70ce37e131b9 None admin] PATH_INFO: `/v3/domains` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:33.057596 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f09a11-8c08-4c3f-bec0-70ce37e131b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:33.057596 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f09a11-8c08-4c3f-bec0-70ce37e131b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:33.057596 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f09a11-8c08-4c3f-bec0-70ce37e131b9 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:33.071687 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 255/519] 10.222.0.70 () {56 vars in 1109 bytes} [Fri Aug 19 15:53:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:33.072622 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f09a11-8c08-4c3f-bec0-70ce37e131b9 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:33.135702 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:33.142174 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57098bc7-5830-4c51-b117-0fe9323d86db None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:33.183648 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da89b4-0955-44e4-a19e-32a0699ce284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:33.184533 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da89b4-0955-44e4-a19e-32a0699ce284 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:33.184990 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da89b4-0955-44e4-a19e-32a0699ce284 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:33.185257 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da89b4-0955-44e4-a19e-32a0699ce284 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:33.188013 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:33.195513 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f09a11-8c08-4c3f-bec0-70ce37e131b9 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:33.197929 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7da89b4-0955-44e4-a19e-32a0699ce284 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:33.199500 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7da89b4-0955-44e4-a19e-32a0699ce284 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:33.214898 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-c7da89b4-0955-44e4-a19e-32a0699ce284 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:33.214898 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:33.214898 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:33.214898 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:33.214898 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:33.214898 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:33.214898 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:33.214898 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:33.214898 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:33.214898 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:33.214898 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:33.214898 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:33.214898 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:53:33.214898 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:53:33.214898 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:53:33.214898 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:53:33.216179 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:33.216179 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:33.216179 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:33.216179 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:33.216179 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:33.216179 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:33.216179 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:33.216179 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:33.216179 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:33.216179 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:33.216179 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:33.216179 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:33.216179 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:33.216179 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:33.216179 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:33.216179 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:33.216179 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:53:33.217185 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:53:33.217185 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:33.217185 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:33.217185 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 265/520] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:53:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:33.217185 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da89b4-0955-44e4-a19e-32a0699ce284 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:33.241354 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865124c-a7e3-4a2b-b625-b00ae978cffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:33.241943 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865124c-a7e3-4a2b-b625-b00ae978cffe None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:33.242208 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865124c-a7e3-4a2b-b625-b00ae978cffe None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:33.242851 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865124c-a7e3-4a2b-b625-b00ae978cffe None admin] PATH_INFO: `/v3/domains` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:33.243111 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5865124c-a7e3-4a2b-b625-b00ae978cffe None admin] RBAC: Adding query filter params (name=Default) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:33.243409 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5865124c-a7e3-4a2b-b625-b00ae978cffe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:33.246072 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5865124c-a7e3-4a2b-b625-b00ae978cffe None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:33.263022 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 256/521] 10.222.0.70 () {56 vars in 1109 bytes} [Fri Aug 19 15:53:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:33.263022 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865124c-a7e3-4a2b-b625-b00ae978cffe None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:33.333653 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da89b4-0955-44e4-a19e-32a0699ce284 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:33.377422 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9531e-f35e-4a46-a02e-c95fab24fb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:33.378310 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9531e-f35e-4a46-a02e-c95fab24fb66 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:33.379836 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9531e-f35e-4a46-a02e-c95fab24fb66 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:33.379836 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9531e-f35e-4a46-a02e-c95fab24fb66 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:33.388364 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb9531e-f35e-4a46-a02e-c95fab24fb66 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:33.389875 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb9531e-f35e-4a46-a02e-c95fab24fb66 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:33.394104 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865124c-a7e3-4a2b-b625-b00ae978cffe None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:33.404583 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-bcb9531e-f35e-4a46-a02e-c95fab24fb66 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:53:33.404583 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:33.404583 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:33.404583 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:33.404583 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:33.404583 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:33.404583 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:33.404583 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:33.404583 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:33.404583 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:33.404583 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:33.404583 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:33.404583 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 15:53:33.404583 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 15:53:33.404583 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 15:53:33.409347 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 15:53:33.409347 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:33.409347 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:33.409347 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:33.409347 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:33.409347 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:33.409347 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:33.409347 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:33.409347 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:33.409347 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:33.409347 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:33.409347 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:33.409347 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:33.409347 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:33.409347 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:33.409347 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:33.409347 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:33.410250 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 15:53:33.410250 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 15:53:33.410250 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 15:53:33.410250 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 15:53:33.410250 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 15:53:33.410250 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 15:53:33.410250 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:53:33.410250 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:33.410250 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 266/522] 10.222.0.70 () {56 vars in 1111 bytes} [Fri Aug 19 15:53:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:33.410250 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9531e-f35e-4a46-a02e-c95fab24fb66 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:33.422283 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:33.441648 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f385e30-5a47-4297-bcc4-928f5e5398a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:33.442265 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f385e30-5a47-4297-bcc4-928f5e5398a9 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:33.442545 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f385e30-5a47-4297-bcc4-928f5e5398a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:33.442819 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f385e30-5a47-4297-bcc4-928f5e5398a9 None admin] PATH_INFO: `/v3/domains` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:33.443503 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f385e30-5a47-4297-bcc4-928f5e5398a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:33.443805 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f385e30-5a47-4297-bcc4-928f5e5398a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:33.445220 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f385e30-5a47-4297-bcc4-928f5e5398a9 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:33.459947 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 257/523] 10.222.0.70 () {56 vars in 1109 bytes} [Fri Aug 19 15:53:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:33.465980 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f385e30-5a47-4297-bcc4-928f5e5398a9 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:33.481985 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:33.534132 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9531e-f35e-4a46-a02e-c95fab24fb66 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:33.578168 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5628dc45-e6b6-4838-b742-25b2897d6c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:33.578804 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628dc45-e6b6-4838-b742-25b2897d6c2a None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:33.579085 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628dc45-e6b6-4838-b742-25b2897d6c2a None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:33.579359 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628dc45-e6b6-4838-b742-25b2897d6c2a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:33.579873 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f385e30-5a47-4297-bcc4-928f5e5398a9 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:33.588439 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5628dc45-e6b6-4838-b742-25b2897d6c2a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:33.589875 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5628dc45-e6b6-4838-b742-25b2897d6c2a None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:33.602181 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-5628dc45-e6b6-4838-b742-25b2897d6c2a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:53:33.602181 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:33.602181 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:33.602181 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:33.602181 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:33.602181 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:33.602181 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:33.602181 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:33.602181 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:33.602181 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:33.602181 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:33.602181 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:33.602181 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 15:53:33.602181 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 15:53:33.602181 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 15:53:33.603055 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 15:53:33.603055 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:33.603055 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:33.603055 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:33.603055 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:33.603055 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:33.603055 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:33.603055 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:33.603055 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:33.603055 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:33.603055 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:33.603055 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:33.603055 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:33.603055 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:33.603055 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:33.603055 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:33.603055 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:33.604720 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 15:53:33.604720 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 15:53:33.604720 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 15:53:33.604720 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 15:53:33.604720 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 15:53:33.604720 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 15:53:33.604720 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:53:33.604720 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:33.604720 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 267/524] 10.222.0.70 () {56 vars in 1111 bytes} [Fri Aug 19 15:53:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:33.604720 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5628dc45-e6b6-4838-b742-25b2897d6c2a None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:33.624966 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a231cb6-2db2-49ad-81d4-7cdef39ff23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:33.625581 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a231cb6-2db2-49ad-81d4-7cdef39ff23b None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:33.625852 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a231cb6-2db2-49ad-81d4-7cdef39ff23b None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:33.626126 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a231cb6-2db2-49ad-81d4-7cdef39ff23b None admin] PATH_INFO: `/v3/projects` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:33.626822 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a231cb6-2db2-49ad-81d4-7cdef39ff23b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:33.627127 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a231cb6-2db2-49ad-81d4-7cdef39ff23b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:33.628849 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a231cb6-2db2-49ad-81d4-7cdef39ff23b None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:33.653261 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 258/525] 10.222.0.70 () {56 vars in 1148 bytes} [Fri Aug 19 15:53:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:33.653261 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a231cb6-2db2-49ad-81d4-7cdef39ff23b None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:33.686389 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:33.728317 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5628dc45-e6b6-4838-b742-25b2897d6c2a None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:33.743530 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:33.771362 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404025f-deec-4546-b2b2-117b50c062fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:33.772004 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404025f-deec-4546-b2b2-117b50c062fc None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:33.772282 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404025f-deec-4546-b2b2-117b50c062fc None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:33.772555 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404025f-deec-4546-b2b2-117b50c062fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:33.774369 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a231cb6-2db2-49ad-81d4-7cdef39ff23b None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:33.780573 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b404025f-deec-4546-b2b2-117b50c062fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:33.782159 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b404025f-deec-4546-b2b2-117b50c062fc None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:33.795124 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-b404025f-deec-4546-b2b2-117b50c062fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:53:33.795124 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:33.795124 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:33.795124 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:33.795124 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:33.795124 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:33.795124 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:33.795124 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:33.795124 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:33.795124 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:33.795124 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:33.795124 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:33.795124 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 15:53:33.795124 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 15:53:33.795124 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 15:53:33.796171 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 15:53:33.796171 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:33.796171 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:33.796171 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:33.796171 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:33.796171 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:33.796171 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:33.796171 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:33.796171 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:33.796171 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:33.796171 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:33.796171 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:33.796171 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:33.796171 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:33.796171 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:33.796171 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:33.796171 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:33.797087 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 15:53:33.797087 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 15:53:33.797087 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 15:53:33.797087 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 15:53:33.797087 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 15:53:33.797087 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 15:53:33.797087 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:53:33.797087 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:33.797087 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 268/526] 10.222.0.70 () {56 vars in 1111 bytes} [Fri Aug 19 15:53:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:33.797620 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404025f-deec-4546-b2b2-117b50c062fc None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:33.824877 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a748e-b763-4293-b282-3b6427f0c1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:33.826052 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a748e-b763-4293-b282-3b6427f0c1b1 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:33.826488 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a748e-b763-4293-b282-3b6427f0c1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:33.826760 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a748e-b763-4293-b282-3b6427f0c1b1 None admin] PATH_INFO: `/v3/projects` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:33.827520 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078a748e-b763-4293-b282-3b6427f0c1b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:33.827825 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078a748e-b763-4293-b282-3b6427f0c1b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:33.829293 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078a748e-b763-4293-b282-3b6427f0c1b1 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:33.847178 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 259/527] 10.222.0.70 () {56 vars in 1148 bytes} [Fri Aug 19 15:53:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:33.847178 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a748e-b763-4293-b282-3b6427f0c1b1 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:33.929145 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404025f-deec-4546-b2b2-117b50c062fc None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:33.964337 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a748e-b763-4293-b282-3b6427f0c1b1 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:33.968710 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:33.979018 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f450c-a6c4-45db-bf66-0d81fc34b9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:33.980975 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f450c-a6c4-45db-bf66-0d81fc34b9e0 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:33.980975 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f450c-a6c4-45db-bf66-0d81fc34b9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:33.980975 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f450c-a6c4-45db-bf66-0d81fc34b9e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:33.981947 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f450c-a6c4-45db-bf66-0d81fc34b9e0 None admin] RBAC: Adding query filter params (role.id=f082292a9c404c30891116a86c08becd, scope.project.id=48fb7e21c6864d30b70ffca9093afec8, user.id=3d70aff7f0a448bb9a5cc2b78c828590) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:33.982257 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f450c-a6c4-45db-bf66-0d81fc34b9e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:33.984205 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f450c-a6c4-45db-bf66-0d81fc34b9e0 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:33.990997 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 269/528] 10.222.0.70 () {56 vars in 1374 bytes} [Fri Aug 19 15:53:33 2022] GET /identity/v3/role_assignments?user.id=3d70aff7f0a448bb9a5cc2b78c828590&scope.project.id=48fb7e21c6864d30b70ffca9093afec8&role.id=f082292a9c404c30891116a86c08becd => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:33.991939 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f450c-a6c4-45db-bf66-0d81fc34b9e0 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:34.020206 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5e7ff-fc7f-4797-b8fc-bf6150decf64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:34.021287 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5e7ff-fc7f-4797-b8fc-bf6150decf64 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:34.021798 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5e7ff-fc7f-4797-b8fc-bf6150decf64 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:34.022324 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5e7ff-fc7f-4797-b8fc-bf6150decf64 None admin] PATH_INFO: `/v3/projects` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:34.023315 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f5e7ff-fc7f-4797-b8fc-bf6150decf64 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:34.024014 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f5e7ff-fc7f-4797-b8fc-bf6150decf64 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:34.027883 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f5e7ff-fc7f-4797-b8fc-bf6150decf64 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:34.028511 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:34.047780 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 260/529] 10.222.0.70 () {56 vars in 1148 bytes} [Fri Aug 19 15:53:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:34.049443 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5e7ff-fc7f-4797-b8fc-bf6150decf64 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:34.156518 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f450c-a6c4-45db-bf66-0d81fc34b9e0 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:34.177060 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5e7ff-fc7f-4797-b8fc-bf6150decf64 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:34.207304 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9fa1b1-c9cd-4baf-9ee0-bd59b98bdb26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:34.208561 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9fa1b1-c9cd-4baf-9ee0-bd59b98bdb26 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:34.209074 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9fa1b1-c9cd-4baf-9ee0-bd59b98bdb26 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:34.209708 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9fa1b1-c9cd-4baf-9ee0-bd59b98bdb26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:34.210761 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9fa1b1-c9cd-4baf-9ee0-bd59b98bdb26 None admin] RBAC: Adding query filter params (role.id=f082292a9c404c30891116a86c08becd, scope.project.id=48fb7e21c6864d30b70ffca9093afec8, user.id=92eb2988fd86400dacb28eeef921a4b8) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:34.212170 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9fa1b1-c9cd-4baf-9ee0-bd59b98bdb26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:34.214225 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9fa1b1-c9cd-4baf-9ee0-bd59b98bdb26 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:34.220427 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 270/530] 10.222.0.70 () {56 vars in 1374 bytes} [Fri Aug 19 15:53:33 2022] GET /identity/v3/role_assignments?user.id=92eb2988fd86400dacb28eeef921a4b8&scope.project.id=48fb7e21c6864d30b70ffca9093afec8&role.id=f082292a9c404c30891116a86c08becd => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:34.224031 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbc6189-de42-4cd8-a1fe-82301c0b0ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:34.224675 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc6189-de42-4cd8-a1fe-82301c0b0ca8 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:34.224984 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc6189-de42-4cd8-a1fe-82301c0b0ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:34.225255 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc6189-de42-4cd8-a1fe-82301c0b0ca8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:34.226126 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbc6189-de42-4cd8-a1fe-82301c0b0ca8 None admin] RBAC: Adding query filter params (role.id=f082292a9c404c30891116a86c08becd, scope.project.id=48fb7e21c6864d30b70ffca9093afec8, user.id=f5593ee9d30b4b65a215a4fe8dfba060) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:34.226443 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbc6189-de42-4cd8-a1fe-82301c0b0ca8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:34.227942 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbc6189-de42-4cd8-a1fe-82301c0b0ca8 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:34.235368 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 261/531] 10.222.0.70 () {56 vars in 1374 bytes} [Fri Aug 19 15:53:34 2022] GET /identity/v3/role_assignments?user.id=f5593ee9d30b4b65a215a4fe8dfba060&scope.project.id=48fb7e21c6864d30b70ffca9093afec8&role.id=f082292a9c404c30891116a86c08becd => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:35.132093 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf2f01-59c7-4efc-b0dc-9c68fe9bb8b1 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:35.132621 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf2f01-59c7-4efc-b0dc-9c68fe9bb8b1 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:35.132621 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf2f01-59c7-4efc-b0dc-9c68fe9bb8b1 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:35.134266 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 271/532] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:53:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:53:35.140084 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a99de2-c2ca-4506-a987-a596e64d65d0 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:35.140558 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a99de2-c2ca-4506-a987-a596e64d65d0 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:35.140631 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a99de2-c2ca-4506-a987-a596e64d65d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:35.159759 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-b0a99de2-c2ca-4506-a987-a596e64d65d0 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:53:35.161001 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-b0a99de2-c2ca-4506-a987-a596e64d65d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:53:35.222539 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:35.238791 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 262/533] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:53:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:53:35.580366 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf2f01-59c7-4efc-b0dc-9c68fe9bb8b1 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:35.646884 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:35.699694 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf2f01-59c7-4efc-b0dc-9c68fe9bb8b1 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:35.742850 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11275bdd-855b-40e2-9e83-68b257dd06b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:35.743485 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11275bdd-855b-40e2-9e83-68b257dd06b8 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:35.743760 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11275bdd-855b-40e2-9e83-68b257dd06b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:35.744941 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11275bdd-855b-40e2-9e83-68b257dd06b8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:35.757037 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11275bdd-855b-40e2-9e83-68b257dd06b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:53:35.763360 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-11275bdd-855b-40e2-9e83-68b257dd06b8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:53:35.763360 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:35.763360 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:35.763360 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:35.763360 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:35.763360 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:35.763360 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:35.763360 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:35.763360 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:35.763360 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:35.763360 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:35.763360 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:35.763360 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:53:35.763360 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:53:35.763360 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:53:35.763360 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:53:35.764265 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:53:35.764265 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:53:35.764265 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:53:35.764265 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:53:35.764265 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:35.764265 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:35.764265 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:35.764265 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:35.764265 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:35.764265 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:35.764265 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:35.764265 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:35.764265 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:35.764265 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:35.764265 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:35.764265 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:35.765186 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:35.765186 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:35.765186 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:35.765186 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:35.765186 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:53:35.765186 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:53:35.765186 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:53:35.765186 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:53:35.765186 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:53:35.765186 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:53:35.765186 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:53:35.765186 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:35.765186 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 272/534] 10.222.0.70 () {56 vars in 1102 bytes} [Fri Aug 19 15:53:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:35.770617 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a99de2-c2ca-4506-a987-a596e64d65d0 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:35.878623 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a99de2-c2ca-4506-a987-a596e64d65d0 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:35.918891 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9d51d-1a00-410f-8a3c-293aff4445a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:35.919891 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9d51d-1a00-410f-8a3c-293aff4445a3 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:35.920366 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9d51d-1a00-410f-8a3c-293aff4445a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:35.920862 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9d51d-1a00-410f-8a3c-293aff4445a3 None admin] PATH_INFO: `/v3/roles` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:35.921893 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d9d51d-1a00-410f-8a3c-293aff4445a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:35.922394 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d9d51d-1a00-410f-8a3c-293aff4445a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:35.923973 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d9d51d-1a00-410f-8a3c-293aff4445a3 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:35.934304 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 263/535] 10.222.0.70 () {56 vars in 1103 bytes} [Fri Aug 19 15:53:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:35.940169 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11275bdd-855b-40e2-9e83-68b257dd06b8 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:36.070288 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11275bdd-855b-40e2-9e83-68b257dd06b8 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:36.088307 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:36.107480 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39696f2c-a51f-4f93-954d-6549ae18787e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:36.108124 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39696f2c-a51f-4f93-954d-6549ae18787e None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:36.108403 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39696f2c-a51f-4f93-954d-6549ae18787e None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:36.108696 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39696f2c-a51f-4f93-954d-6549ae18787e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:36.120430 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39696f2c-a51f-4f93-954d-6549ae18787e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:36.121949 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39696f2c-a51f-4f93-954d-6549ae18787e None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:36.138733 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-39696f2c-a51f-4f93-954d-6549ae18787e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:36.138733 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:36.138733 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:36.138733 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:36.138733 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:36.138733 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:36.138733 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:36.138733 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:36.138733 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:36.138733 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:36.138733 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:36.138733 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:36.138733 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:53:36.138733 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:53:36.138733 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:53:36.138733 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:53:36.140084 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:36.140084 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:36.140084 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:36.140084 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:36.140084 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:36.140084 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:36.140084 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:36.140084 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:36.140084 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:36.140084 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:36.140084 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:36.140084 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:36.140084 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:36.140084 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:36.140084 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:36.140084 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:36.140084 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:53:36.140981 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:53:36.140981 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:36.140981 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:36.140981 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 273/536] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:53:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:36.150128 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9d51d-1a00-410f-8a3c-293aff4445a3 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:36.206979 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:36.269027 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9d51d-1a00-410f-8a3c-293aff4445a3 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:36.311085 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4034a34b-8ca8-49e9-a8e8-c24a3de14c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:36.312134 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034a34b-8ca8-49e9-a8e8-c24a3de14c4b None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:36.312621 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034a34b-8ca8-49e9-a8e8-c24a3de14c4b None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:36.313128 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034a34b-8ca8-49e9-a8e8-c24a3de14c4b None admin] PATH_INFO: `/v3/domains` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:36.314148 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4034a34b-8ca8-49e9-a8e8-c24a3de14c4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:36.314665 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4034a34b-8ca8-49e9-a8e8-c24a3de14c4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:36.316377 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4034a34b-8ca8-49e9-a8e8-c24a3de14c4b None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:36.331028 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 264/537] 10.222.0.70 () {56 vars in 1109 bytes} [Fri Aug 19 15:53:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:36.337006 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39696f2c-a51f-4f93-954d-6549ae18787e None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:36.418992 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ca720-7b84-471d-af7f-2af89283391f None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:36.419380 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ca720-7b84-471d-af7f-2af89283391f None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:36.419873 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ca720-7b84-471d-af7f-2af89283391f None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:36.427016 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 265/538] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:53:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:53:36.428860 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a62753-c869-44c6-b1c6-26e42491d0bf None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:36.429153 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a62753-c869-44c6-b1c6-26e42491d0bf None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:36.429443 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a62753-c869-44c6-b1c6-26e42491d0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:36.451198 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-b3a62753-c869-44c6-b1c6-26e42491d0bf None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:53:36.453296 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-b3a62753-c869-44c6-b1c6-26e42491d0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:53:36.460091 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39696f2c-a51f-4f93-954d-6549ae18787e None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:36.499443 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d724935c-da86-4987-a6cd-889f12d98cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:36.500510 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724935c-da86-4987-a6cd-889f12d98cd2 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:36.501025 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724935c-da86-4987-a6cd-889f12d98cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:36.501494 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724935c-da86-4987-a6cd-889f12d98cd2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:36.510752 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d724935c-da86-4987-a6cd-889f12d98cd2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:36.512721 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d724935c-da86-4987-a6cd-889f12d98cd2 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:36.533581 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-d724935c-da86-4987-a6cd-889f12d98cd2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 15:53:36.533581 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:36.533581 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:36.533581 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:36.533581 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:36.533581 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:36.533581 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:36.533581 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:36.533581 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:36.533581 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:36.533581 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:36.533581 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:36.533581 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 15:53:36.533581 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 15:53:36.533581 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 15:53:36.533581 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 15:53:36.534662 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:36.534662 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:36.534662 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 15:53:36.534662 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:53:36.534662 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 15:53:36.534662 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:53:36.534662 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:36.534662 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:36.534662 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:36.534662 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:36.534662 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:36.534662 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:36.534662 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:36.534662 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:36.534662 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:36.534662 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:36.534662 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:36.534662 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:36.535564 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:36.535564 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:36.535564 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 15:53:36.535564 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 15:53:36.535564 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 15:53:36.535564 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 15:53:36.535564 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 15:53:36.535564 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 15:53:36.535564 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 15:53:36.535564 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:36.535564 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 274/539] 10.222.0.70 () {56 vars in 1093 bytes} [Fri Aug 19 15:53:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:36.541832 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d724935c-da86-4987-a6cd-889f12d98cd2 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:36.550403 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 266/540] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:53:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:53:36.582488 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:36.660411 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d724935c-da86-4987-a6cd-889f12d98cd2 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:36.693834 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b01b95-de3e-4d13-a24c-e88801feb5b7 None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:36.693834 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b01b95-de3e-4d13-a24c-e88801feb5b7 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:36.694259 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b01b95-de3e-4d13-a24c-e88801feb5b7 None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:36.695777 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 267/541] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:53:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 15:53:36.699643 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb58e2e-7fbf-4cba-b5f6-82b07bb5ff3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:36.700571 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb58e2e-7fbf-4cba-b5f6-82b07bb5ff3f None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:36.701095 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb58e2e-7fbf-4cba-b5f6-82b07bb5ff3f None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:36.701577 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb58e2e-7fbf-4cba-b5f6-82b07bb5ff3f None admin] PATH_INFO: `/v3/users` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:36.702562 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb58e2e-7fbf-4cba-b5f6-82b07bb5ff3f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:36.703086 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535d049-bbaa-4b51-acaf-698f17023689 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:36.703203 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb58e2e-7fbf-4cba-b5f6-82b07bb5ff3f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:36.703359 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535d049-bbaa-4b51-acaf-698f17023689 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:36.703629 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535d049-bbaa-4b51-acaf-698f17023689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:36.705231 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb58e2e-7fbf-4cba-b5f6-82b07bb5ff3f None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:36.725242 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 275/542] 10.222.0.70 () {56 vars in 1133 bytes} [Fri Aug 19 15:53:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:53:36.726829 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585986e-c327-4920-9d4f-16a9d08aaed6 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:36.727314 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585986e-c327-4920-9d4f-16a9d08aaed6 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:36.727801 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585986e-c327-4920-9d4f-16a9d08aaed6 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:36.730163 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 276/543] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:53:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:53:36.730382 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-0535d049-bbaa-4b51-acaf-698f17023689 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:53:36.731661 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-0535d049-bbaa-4b51-acaf-698f17023689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:53:36.732124 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f585986e-c327-4920-9d4f-16a9d08aaed6 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:36.773371 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:36.812990 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 268/544] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:53:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 15:53:36.812990 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5d912-1c77-4800-86d7-06b5c3fd8071 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:36.812990 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5d912-1c77-4800-86d7-06b5c3fd8071 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:36.812990 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5d912-1c77-4800-86d7-06b5c3fd8071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:36.835586 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-d7b5d912-1c77-4800-86d7-06b5c3fd8071 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:53:36.837403 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:36.838891 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-d7b5d912-1c77-4800-86d7-06b5c3fd8071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:53:36.856208 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f585986e-c327-4920-9d4f-16a9d08aaed6 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:36.901387 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bb6ff0-0ead-4e18-846f-2e332a17c34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:36.902043 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb6ff0-0ead-4e18-846f-2e332a17c34a None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:36.902318 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb6ff0-0ead-4e18-846f-2e332a17c34a None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:36.902587 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb6ff0-0ead-4e18-846f-2e332a17c34a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:36.913328 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bb6ff0-0ead-4e18-846f-2e332a17c34a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:36.914805 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bb6ff0-0ead-4e18-846f-2e332a17c34a None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:36.930463 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-a3bb6ff0-0ead-4e18-846f-2e332a17c34a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:36.930463 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:36.930463 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:36.930463 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:36.930463 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:36.930463 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:36.930463 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:36.930463 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:36.930463 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:36.930463 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:36.930463 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:36.930463 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:36.930463 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:53:36.930463 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:53:36.930463 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:53:36.930463 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:53:36.931401 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:36.931401 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:36.931401 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:36.931401 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:36.931401 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:36.931401 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:36.931401 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:36.931401 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:36.931401 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:36.931401 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:36.931401 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:36.931401 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:36.931401 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:36.931401 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:36.931401 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:36.931401 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:36.931401 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:53:36.937925 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:53:36.937925 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:36.937925 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:36.937925 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 277/545] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:53:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:36.937925 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bb6ff0-0ead-4e18-846f-2e332a17c34a None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:36.939260 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 269/546] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:53:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:53:36.940534 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b5d912-1c77-4800-86d7-06b5c3fd8071 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:37.068931 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b5d912-1c77-4800-86d7-06b5c3fd8071 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:37.069275 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bb6ff0-0ead-4e18-846f-2e332a17c34a None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:37.081155 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:37.113490 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06c773-66ab-45ac-9f84-125cdd02c957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:37.114124 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06c773-66ab-45ac-9f84-125cdd02c957 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:37.114395 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06c773-66ab-45ac-9f84-125cdd02c957 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:37.119601 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06c773-66ab-45ac-9f84-125cdd02c957 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:37.119771 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2141380-5424-4fd1-9d3f-2c4ab7dcae9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:37.119771 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2141380-5424-4fd1-9d3f-2c4ab7dcae9b None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:37.119771 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2141380-5424-4fd1-9d3f-2c4ab7dcae9b None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:37.119771 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2141380-5424-4fd1-9d3f-2c4ab7dcae9b None admin] PATH_INFO: `/v3/domains` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:37.120055 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2141380-5424-4fd1-9d3f-2c4ab7dcae9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:37.120055 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2141380-5424-4fd1-9d3f-2c4ab7dcae9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:37.121440 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2141380-5424-4fd1-9d3f-2c4ab7dcae9b None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:37.122477 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:37.128236 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c06c773-66ab-45ac-9f84-125cdd02c957 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:53:37.133719 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-5c06c773-66ab-45ac-9f84-125cdd02c957 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:53:37.133719 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:37.133719 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:37.133719 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:37.133719 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:37.133719 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:37.133719 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:37.133719 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:37.133719 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:37.133719 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:37.133719 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:37.133719 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:37.133719 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:53:37.133719 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:53:37.133719 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:53:37.133719 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:53:37.134669 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:53:37.134669 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:53:37.134669 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:53:37.134669 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:53:37.134669 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:37.134669 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:37.134669 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:37.134669 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:37.134669 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:37.134669 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:37.134669 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:37.134669 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:37.134669 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:37.134669 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:37.134669 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:37.134669 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:37.141221 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:37.141221 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:37.141221 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:37.141221 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:37.141221 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:53:37.141221 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:53:37.141221 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:53:37.141221 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:53:37.141221 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:53:37.141221 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:53:37.141221 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:53:37.141221 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:37.141221 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 278/547] 10.222.0.70 () {56 vars in 1102 bytes} [Fri Aug 19 15:53:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:37.142326 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 270/548] 10.222.0.70 () {56 vars in 1109 bytes} [Fri Aug 19 15:53:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:37.143803 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06c773-66ab-45ac-9f84-125cdd02c957 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:37.147400 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2141380-5424-4fd1-9d3f-2c4ab7dcae9b None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:37.272056 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06c773-66ab-45ac-9f84-125cdd02c957 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:37.272359 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2141380-5424-4fd1-9d3f-2c4ab7dcae9b None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:37.310572 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8734d2-5d75-41e0-a990-405ee02e78e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:37.310827 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5208ca-fdb9-4851-aeb4-c7327fdb69b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:37.311244 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5208ca-fdb9-4851-aeb4-c7327fdb69b3 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:37.311447 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8734d2-5d75-41e0-a990-405ee02e78e9 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:37.311548 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5208ca-fdb9-4851-aeb4-c7327fdb69b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:37.311730 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8734d2-5d75-41e0-a990-405ee02e78e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:37.311831 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5208ca-fdb9-4851-aeb4-c7327fdb69b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:37.312011 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8734d2-5d75-41e0-a990-405ee02e78e9 None admin] PATH_INFO: `/v3/roles` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:37.312704 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8734d2-5d75-41e0-a990-405ee02e78e9 None admin] RBAC: Adding query filter params (name=service) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:37.313015 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8734d2-5d75-41e0-a990-405ee02e78e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:37.314415 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8734d2-5d75-41e0-a990-405ee02e78e9 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:37.319245 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5208ca-fdb9-4851-aeb4-c7327fdb69b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:37.320617 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5208ca-fdb9-4851-aeb4-c7327fdb69b3 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:37.322961 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 279/549] 10.222.0.70 () {56 vars in 1103 bytes} [Fri Aug 19 15:53:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:53:37.323794 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8734d2-5d75-41e0-a990-405ee02e78e9 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:37.334409 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-9f5208ca-fdb9-4851-aeb4-c7327fdb69b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:53:37.334409 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:37.334409 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:37.334409 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:37.334409 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:37.334409 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:37.334409 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:37.334409 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:37.334409 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:37.334409 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:37.334409 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:37.334409 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:37.334409 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 15:53:37.334409 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 15:53:37.334409 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 15:53:37.335335 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 15:53:37.335335 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:37.335335 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:37.335335 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:37.335335 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:37.335335 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:37.335335 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:37.335335 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:37.335335 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:37.335335 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:37.335335 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:37.335335 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:37.335335 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:37.335335 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:37.335335 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:37.335335 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:37.335335 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:37.346753 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 15:53:37.346753 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 15:53:37.346753 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 15:53:37.346753 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 15:53:37.346753 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 15:53:37.346753 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 15:53:37.346753 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:53:37.346753 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:53:37.346753 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 271/550] 10.222.0.70 () {56 vars in 1111 bytes} [Fri Aug 19 15:53:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:37.346753 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5208ca-fdb9-4851-aeb4-c7327fdb69b3 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:37.365975 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:37.397669 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:37.443593 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8734d2-5d75-41e0-a990-405ee02e78e9 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:37.453073 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5208ca-fdb9-4851-aeb4-c7327fdb69b3 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:37.479640 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad8988-a0cc-474f-9e87-1798098f5b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:37.480274 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad8988-a0cc-474f-9e87-1798098f5b57 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:37.480548 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad8988-a0cc-474f-9e87-1798098f5b57 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:37.480855 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad8988-a0cc-474f-9e87-1798098f5b57 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:37.488499 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6420ea-416f-4045-b4ea-19d74145760f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:37.489149 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6420ea-416f-4045-b4ea-19d74145760f None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:37.489746 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6420ea-416f-4045-b4ea-19d74145760f None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:37.489746 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6420ea-416f-4045-b4ea-19d74145760f None admin] PATH_INFO: `/v3/roles/service` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:37.491836 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faad8988-a0cc-474f-9e87-1798098f5b57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:53:37.497414 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-faad8988-a0cc-474f-9e87-1798098f5b57 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:53:37.497414 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:37.497414 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:37.497414 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:37.497414 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:37.497414 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:37.497414 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:37.497414 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:37.497414 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:37.497414 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:37.497414 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:37.497414 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:37.497414 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:53:37.497414 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:53:37.497414 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:53:37.497414 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:53:37.499099 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:53:37.499099 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:53:37.499099 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:53:37.499099 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:53:37.499099 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:37.499099 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:37.499099 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:37.499099 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:37.499099 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:37.499099 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:37.499099 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:37.499099 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:37.499099 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:37.499099 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:37.499099 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:37.499099 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:37.499906 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:37.499906 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:37.499906 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:37.499906 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:37.499906 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:53:37.499906 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:53:37.499906 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:53:37.499906 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:53:37.499906 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:53:37.499906 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:53:37.499906 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:53:37.499906 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:37.499906 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 280/551] 10.222.0.70 () {56 vars in 1102 bytes} [Fri Aug 19 15:53:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:37.499906 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad8988-a0cc-474f-9e87-1798098f5b57 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:37.500724 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6420ea-416f-4045-b4ea-19d74145760f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:53:37.507007 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-2a6420ea-416f-4045-b4ea-19d74145760f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:53:37.507007 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:37.507007 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:37.507007 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:37.507007 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:37.507007 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:37.507007 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:37.507007 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:37.507007 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:37.507007 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:37.507007 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:37.507007 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:37.507007 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:53:37.507007 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:53:37.507007 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:53:37.507007 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:53:37.508091 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:53:37.508091 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:53:37.508091 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:53:37.508091 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:53:37.508091 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:37.508091 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:37.508091 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:37.508091 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:37.508091 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:37.508091 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:37.508091 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:37.508091 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:37.508091 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:37.508091 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:37.508091 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:37.508091 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:37.509472 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:37.509472 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:37.509472 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:37.509472 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:37.509472 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:53:37.509472 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:53:37.509472 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:53:37.509472 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:53:37.509472 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:53:37.509472 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:53:37.509472 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:53:37.509472 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:53:37.509472 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 272/552] 10.222.0.70 () {56 vars in 1102 bytes} [Fri Aug 19 15:53:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:37.509472 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6420ea-416f-4045-b4ea-19d74145760f None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:37.594408 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:37.606267 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad8988-a0cc-474f-9e87-1798098f5b57 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:37.613174 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6420ea-416f-4045-b4ea-19d74145760f None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:37.626451 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:37.640833 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c3d74e-7d5c-458f-8d0c-a7cf7d58fa88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:37.641454 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3d74e-7d5c-458f-8d0c-a7cf7d58fa88 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:37.641727 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3d74e-7d5c-458f-8d0c-a7cf7d58fa88 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:37.642005 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3d74e-7d5c-458f-8d0c-a7cf7d58fa88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:37.648575 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff8514-da18-4a70-8b79-29107eb29be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:37.649198 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff8514-da18-4a70-8b79-29107eb29be8 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:37.649473 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff8514-da18-4a70-8b79-29107eb29be8 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:37.649742 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff8514-da18-4a70-8b79-29107eb29be8 None admin] PATH_INFO: `/v3/projects` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:37.650979 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeff8514-da18-4a70-8b79-29107eb29be8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:37.651278 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeff8514-da18-4a70-8b79-29107eb29be8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:37.652587 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c3d74e-7d5c-458f-8d0c-a7cf7d58fa88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:37.652728 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeff8514-da18-4a70-8b79-29107eb29be8 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:37.654159 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c3d74e-7d5c-458f-8d0c-a7cf7d58fa88 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:37.664211 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 273/553] 10.222.0.70 () {56 vars in 1148 bytes} [Fri Aug 19 15:53:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:37.665100 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff8514-da18-4a70-8b79-29107eb29be8 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:37.670045 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-d6c3d74e-7d5c-458f-8d0c-a7cf7d58fa88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:37.670045 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:37.670045 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:37.670045 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:37.670045 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:37.670045 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:37.670045 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:37.670045 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:37.670045 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:37.670045 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:37.670045 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:37.670045 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:37.670045 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:53:37.670045 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:53:37.670045 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:53:37.670045 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:53:37.675927 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:37.675927 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:37.675927 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:37.675927 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:37.675927 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:37.675927 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:37.675927 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:37.675927 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:37.675927 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:37.675927 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:37.675927 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:37.675927 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:37.675927 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:37.675927 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:37.675927 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:37.675927 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:37.675927 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:53:37.677188 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:53:37.677188 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:37.677188 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:37.677188 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 281/554] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:53:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:37.677188 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c3d74e-7d5c-458f-8d0c-a7cf7d58fa88 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:37.770534 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff8514-da18-4a70-8b79-29107eb29be8 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:37.776539 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c3d74e-7d5c-458f-8d0c-a7cf7d58fa88 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:37.803938 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e421986-1ecc-41db-8e5b-5d4eca4758ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:37.804597 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e421986-1ecc-41db-8e5b-5d4eca4758ff None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:37.804905 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e421986-1ecc-41db-8e5b-5d4eca4758ff None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:37.805181 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e421986-1ecc-41db-8e5b-5d4eca4758ff None admin] PATH_INFO: `/v3/roles` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:37.805832 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e421986-1ecc-41db-8e5b-5d4eca4758ff None admin] RBAC: Adding query filter params (name=service) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:37.806190 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e421986-1ecc-41db-8e5b-5d4eca4758ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:37.808039 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e421986-1ecc-41db-8e5b-5d4eca4758ff None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:37.809728 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9021fac3-3cbb-4fab-89be-6a2d92899018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:37.810334 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021fac3-3cbb-4fab-89be-6a2d92899018 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:37.810614 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021fac3-3cbb-4fab-89be-6a2d92899018 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:37.810888 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021fac3-3cbb-4fab-89be-6a2d92899018 None admin] PATH_INFO: `/v3/roles` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:37.811547 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9021fac3-3cbb-4fab-89be-6a2d92899018 None admin] RBAC: Adding query filter params (name=service) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:37.811850 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9021fac3-3cbb-4fab-89be-6a2d92899018 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:37.813242 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9021fac3-3cbb-4fab-89be-6a2d92899018 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:37.815898 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 274/555] 10.222.0.70 () {56 vars in 1103 bytes} [Fri Aug 19 15:53:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:37.816694 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e421986-1ecc-41db-8e5b-5d4eca4758ff None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:37.819238 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:37.824785 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 282/556] 10.222.0.70 () {56 vars in 1103 bytes} [Fri Aug 19 15:53:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:37.830254 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9021fac3-3cbb-4fab-89be-6a2d92899018 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:37.860424 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:37.921903 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e421986-1ecc-41db-8e5b-5d4eca4758ff None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:37.928282 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9021fac3-3cbb-4fab-89be-6a2d92899018 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:37.956090 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4b4ae-7a9d-41ca-a89a-5dbe0d7e42e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:37.956865 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4b4ae-7a9d-41ca-a89a-5dbe0d7e42e2 None admin] REQUEST_METHOD: `PUT` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:37.957044 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4b4ae-7a9d-41ca-a89a-5dbe0d7e42e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:37.957315 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4b4ae-7a9d-41ca-a89a-5dbe0d7e42e2 None admin] PATH_INFO: `/v3/projects/48fb7e21c6864d30b70ffca9093afec8/users/d90cec9e3ff64b5aa4cc867895b996ad/roles/f082292a9c404c30891116a86c08becd` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:37.962147 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac1a7b1-63cc-4564-b56d-53769952e650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:37.962838 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1a7b1-63cc-4564-b56d-53769952e650 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:37.963152 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1a7b1-63cc-4564-b56d-53769952e650 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:37.963426 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1a7b1-63cc-4564-b56d-53769952e650 None admin] PATH_INFO: `/v3/domains` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:37.964061 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac1a7b1-63cc-4564-b56d-53769952e650 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:37.964361 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac1a7b1-63cc-4564-b56d-53769952e650 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:37.965771 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac1a7b1-63cc-4564-b56d-53769952e650 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:37.971716 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b4b4ae-7a9d-41ca-a89a-5dbe0d7e42e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=48fb7e21c6864d30b70ffca9093afec8, user_id=d90cec9e3ff64b5aa4cc867895b996ad, role_id=f082292a9c404c30891116a86c08becd)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:37.973148 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b4b4ae-7a9d-41ca-a89a-5dbe0d7e42e2 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:37.977637 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 283/557] 10.222.0.70 () {56 vars in 1109 bytes} [Fri Aug 19 15:53:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:37.978467 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac1a7b1-63cc-4564-b56d-53769952e650 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:38.075365 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 275/558] 10.222.0.70 () {58 vars in 1439 bytes} [Fri Aug 19 15:53:37 2022] PUT /identity/v3/projects/48fb7e21c6864d30b70ffca9093afec8/users/d90cec9e3ff64b5aa4cc867895b996ad/roles/f082292a9c404c30891116a86c08becd => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:53:38.076608 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4b4ae-7a9d-41ca-a89a-5dbe0d7e42e2 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:38.086503 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:38.095676 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac1a7b1-63cc-4564-b56d-53769952e650 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:38.140571 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c202c-13ff-4fbb-973e-55e3b6cf3bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:38.141239 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c202c-13ff-4fbb-973e-55e3b6cf3bde None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:38.141451 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c202c-13ff-4fbb-973e-55e3b6cf3bde None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:38.141714 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c202c-13ff-4fbb-973e-55e3b6cf3bde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:38.143671 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:38.155078 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85c202c-13ff-4fbb-973e-55e3b6cf3bde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:38.156652 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85c202c-13ff-4fbb-973e-55e3b6cf3bde None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:38.174703 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-d85c202c-13ff-4fbb-973e-55e3b6cf3bde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:38.174703 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:38.174703 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:38.174703 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:38.174703 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:38.174703 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:38.174703 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:38.174703 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:38.174703 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:38.174703 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:38.174703 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:38.174703 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:38.174703 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:53:38.174703 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:53:38.174703 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:53:38.174703 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:53:38.175713 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:38.175713 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:38.175713 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:38.175713 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:38.175713 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:38.175713 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:38.175713 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:38.175713 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:38.175713 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:38.175713 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:38.175713 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:38.175713 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:38.175713 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:38.175713 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:38.175713 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:38.175713 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:38.175713 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:53:38.176581 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:53:38.176581 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:38.176581 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:38.185402 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 284/559] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:53:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:38.186790 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c202c-13ff-4fbb-973e-55e3b6cf3bde None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:38.216833 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4b4ae-7a9d-41ca-a89a-5dbe0d7e42e2 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:38.264577 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f99751d-27b1-4d5f-9dc1-2b21f239e527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:38.264577 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99751d-27b1-4d5f-9dc1-2b21f239e527 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:38.264577 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99751d-27b1-4d5f-9dc1-2b21f239e527 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:38.264577 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99751d-27b1-4d5f-9dc1-2b21f239e527 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:38.279071 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f99751d-27b1-4d5f-9dc1-2b21f239e527 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:38.281856 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f99751d-27b1-4d5f-9dc1-2b21f239e527 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:38.299523 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-7f99751d-27b1-4d5f-9dc1-2b21f239e527 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:38.299523 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:38.299523 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:38.299523 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:38.299523 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:38.299523 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:38.299523 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:38.299523 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:38.299523 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:38.299523 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:38.299523 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:38.299523 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:38.299523 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:53:38.299523 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:53:38.299523 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:53:38.299523 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:53:38.300550 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:38.300550 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:38.300550 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:38.300550 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:38.300550 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:38.300550 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:38.300550 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:38.300550 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:38.300550 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:38.300550 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:38.300550 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:38.300550 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:38.300550 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:38.300550 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:38.300550 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:38.300550 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:38.300550 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:53:38.302073 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:53:38.302073 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:38.302073 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:53:38.302073 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 276/560] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:53:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:38.302073 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f99751d-27b1-4d5f-9dc1-2b21f239e527 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:38.327815 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c202c-13ff-4fbb-973e-55e3b6cf3bde None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:38.370227 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae989c5-d8b7-468f-bf4e-7b975b49090b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:38.370862 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae989c5-d8b7-468f-bf4e-7b975b49090b None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:38.371131 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae989c5-d8b7-468f-bf4e-7b975b49090b None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:38.372121 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae989c5-d8b7-468f-bf4e-7b975b49090b None admin] PATH_INFO: `/v3/users/glance` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:38.380054 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae989c5-d8b7-468f-bf4e-7b975b49090b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:38.381704 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae989c5-d8b7-468f-bf4e-7b975b49090b None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:38.398039 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-3ae989c5-d8b7-468f-bf4e-7b975b49090b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 19 15:53:38.398039 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:38.398039 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:38.398039 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:38.398039 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:38.398039 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:38.398039 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:38.398039 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:38.398039 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:38.398039 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:38.398039 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:38.398039 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:38.398039 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 15:53:38.398039 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 15:53:38.398039 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 15:53:38.398039 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 15:53:38.399168 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:38.399168 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:38.399168 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 15:53:38.399168 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:53:38.399168 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 15:53:38.399168 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:53:38.399168 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:38.399168 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:38.399168 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:38.399168 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:38.399168 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:38.399168 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:38.399168 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:38.399168 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:38.399168 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:38.399168 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:38.399168 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:38.399168 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:38.400138 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:38.400138 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:38.400138 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 15:53:38.400138 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 15:53:38.400138 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 15:53:38.400138 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 15:53:38.400138 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 15:53:38.400138 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 15:53:38.400138 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 19 15:53:38.400138 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:38.400138 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 285/561] 10.222.0.70 () {56 vars in 1099 bytes} [Fri Aug 19 15:53:38 2022] GET /identity/v3/users/glance => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:38.400138 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae989c5-d8b7-468f-bf4e-7b975b49090b None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:38.408728 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:38.447057 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f99751d-27b1-4d5f-9dc1-2b21f239e527 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:38.450225 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:38.491005 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c7ee0-cda6-49b3-8af4-2cb7e7efb840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:38.491812 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c7ee0-cda6-49b3-8af4-2cb7e7efb840 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:38.492086 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c7ee0-cda6-49b3-8af4-2cb7e7efb840 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:38.492353 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c7ee0-cda6-49b3-8af4-2cb7e7efb840 None admin] PATH_INFO: `/v3/domains` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:38.493037 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c7ee0-cda6-49b3-8af4-2cb7e7efb840 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:38.493335 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c7ee0-cda6-49b3-8af4-2cb7e7efb840 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:38.495456 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c7ee0-cda6-49b3-8af4-2cb7e7efb840 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:38.514684 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 277/562] 10.222.0.70 () {56 vars in 1109 bytes} [Fri Aug 19 15:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:38.514684 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c7ee0-cda6-49b3-8af4-2cb7e7efb840 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:38.531226 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae989c5-d8b7-468f-bf4e-7b975b49090b None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:38.573894 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7f49e-ed3a-4ce1-a50c-63eaab9f62cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:38.574509 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7f49e-ed3a-4ce1-a50c-63eaab9f62cd None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:38.574786 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7f49e-ed3a-4ce1-a50c-63eaab9f62cd None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:38.575050 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7f49e-ed3a-4ce1-a50c-63eaab9f62cd None admin] PATH_INFO: `/v3/domains` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:38.575845 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd7f49e-ed3a-4ce1-a50c-63eaab9f62cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:38.576135 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd7f49e-ed3a-4ce1-a50c-63eaab9f62cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:38.577617 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd7f49e-ed3a-4ce1-a50c-63eaab9f62cd None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:38.600716 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 286/563] 10.222.0.70 () {56 vars in 1109 bytes} [Fri Aug 19 15:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:38.600716 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7f49e-ed3a-4ce1-a50c-63eaab9f62cd None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:38.629972 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c7ee0-cda6-49b3-8af4-2cb7e7efb840 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:38.678181 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:38.678580 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a34f0-2cf5-4969-8184-e91853e76ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:38.679441 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a34f0-2cf5-4969-8184-e91853e76ce8 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:38.679773 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a34f0-2cf5-4969-8184-e91853e76ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:38.680047 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a34f0-2cf5-4969-8184-e91853e76ce8 None admin] PATH_INFO: `/v3/users` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:38.680839 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99a34f0-2cf5-4969-8184-e91853e76ce8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:38.681119 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99a34f0-2cf5-4969-8184-e91853e76ce8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:38.682696 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99a34f0-2cf5-4969-8184-e91853e76ce8 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:38.704585 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 278/564] 10.222.0.70 () {56 vars in 1137 bytes} [Fri Aug 19 15:53:38 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:38.709158 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a34f0-2cf5-4969-8184-e91853e76ce8 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:38.722594 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7f49e-ed3a-4ce1-a50c-63eaab9f62cd None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:38.737098 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:38.762869 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5839043-bc24-4e2e-98c7-8d0538e70bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:38.763645 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5839043-bc24-4e2e-98c7-8d0538e70bd5 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:38.763783 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5839043-bc24-4e2e-98c7-8d0538e70bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:38.764016 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5839043-bc24-4e2e-98c7-8d0538e70bd5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:38.772447 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5839043-bc24-4e2e-98c7-8d0538e70bd5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:38.774400 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5839043-bc24-4e2e-98c7-8d0538e70bd5 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:38.789361 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-c5839043-bc24-4e2e-98c7-8d0538e70bd5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 15:53:38.789361 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:38.789361 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:38.789361 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:38.789361 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:38.789361 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:38.789361 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:38.789361 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:38.789361 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:38.789361 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:38.789361 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:38.789361 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:38.789361 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 15:53:38.789361 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 15:53:38.789361 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 15:53:38.789361 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 15:53:38.791519 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:38.791519 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:38.791519 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 15:53:38.791519 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:53:38.791519 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 15:53:38.791519 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:53:38.791519 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:38.791519 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:38.791519 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:38.791519 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:38.791519 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:38.791519 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:38.791519 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:38.791519 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:38.791519 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:38.791519 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:38.791519 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:38.791519 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:38.792571 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:38.792571 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:38.792571 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 15:53:38.792571 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 15:53:38.792571 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 15:53:38.792571 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 15:53:38.792571 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 15:53:38.792571 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 15:53:38.792571 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 15:53:38.792571 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:38.792571 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 287/565] 10.222.0.70 () {56 vars in 1099 bytes} [Fri Aug 19 15:53:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:38.792571 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5839043-bc24-4e2e-98c7-8d0538e70bd5 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:38.835146 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a34f0-2cf5-4969-8184-e91853e76ce8 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:38.880641 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff4139-00a0-4dd6-9a39-ed77a8001639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:38.881313 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff4139-00a0-4dd6-9a39-ed77a8001639 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:38.881678 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff4139-00a0-4dd6-9a39-ed77a8001639 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:38.881858 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff4139-00a0-4dd6-9a39-ed77a8001639 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:38.890611 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff4139-00a0-4dd6-9a39-ed77a8001639 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:38.892371 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff4139-00a0-4dd6-9a39-ed77a8001639 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:38.909148 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-15ff4139-00a0-4dd6-9a39-ed77a8001639 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 15:53:38.909148 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:38.909148 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:38.909148 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:38.909148 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:38.909148 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:38.909148 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:38.909148 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:38.909148 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:38.909148 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:38.909148 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:38.909148 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:38.909148 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 15:53:38.909148 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 15:53:38.909148 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 15:53:38.909148 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 15:53:38.910315 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:38.910315 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:38.910315 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 15:53:38.910315 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:53:38.910315 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 15:53:38.910315 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:53:38.910315 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:38.910315 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:38.910315 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:38.910315 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:38.910315 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:38.910315 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:38.910315 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:38.910315 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:38.910315 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:38.910315 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:38.910315 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:38.910315 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:38.911436 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:38.911436 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:38.911436 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 15:53:38.911436 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 15:53:38.911436 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 15:53:38.911436 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 15:53:38.911436 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 15:53:38.911436 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 15:53:38.911436 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 15:53:38.911436 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:53:38.917559 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 279/566] 10.222.0.70 () {56 vars in 1102 bytes} [Fri Aug 19 15:53:38 2022] GET /identity/v3/users/neutron => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:38.918509 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff4139-00a0-4dd6-9a39-ed77a8001639 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:38.921531 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5839043-bc24-4e2e-98c7-8d0538e70bd5 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:38.950755 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:38.961780 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a6d13-98e9-441e-9ed4-e73e9138c44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:38.962408 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a6d13-98e9-441e-9ed4-e73e9138c44a None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:38.969456 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a6d13-98e9-441e-9ed4-e73e9138c44a None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:38.969456 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a6d13-98e9-441e-9ed4-e73e9138c44a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:38.974630 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77a6d13-98e9-441e-9ed4-e73e9138c44a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:38.976234 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77a6d13-98e9-441e-9ed4-e73e9138c44a None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:38.991187 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-c77a6d13-98e9-441e-9ed4-e73e9138c44a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:38.991187 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:38.991187 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:38.991187 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:38.991187 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:38.991187 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:38.991187 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:38.991187 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:38.991187 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:38.991187 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:38.991187 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:38.991187 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:38.991187 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:53:38.991187 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:53:38.991187 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:53:38.991187 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:53:38.992252 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:38.992252 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:38.992252 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:38.992252 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:38.992252 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:38.992252 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:38.992252 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:38.992252 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:38.992252 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:38.992252 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:38.992252 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:38.992252 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:38.992252 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:38.992252 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:38.992252 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:38.992252 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:38.992252 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:53:38.993211 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:53:38.993211 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:38.993211 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:38.993211 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 288/567] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:53:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:38.993752 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a6d13-98e9-441e-9ed4-e73e9138c44a None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:39.023693 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:39.048140 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff4139-00a0-4dd6-9a39-ed77a8001639 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:39.088799 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba9e49-5969-4205-9245-164fcc229fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:39.089464 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba9e49-5969-4205-9245-164fcc229fd2 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:39.089788 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba9e49-5969-4205-9245-164fcc229fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:39.090056 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba9e49-5969-4205-9245-164fcc229fd2 None admin] PATH_INFO: `/v3/users` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:39.090776 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abba9e49-5969-4205-9245-164fcc229fd2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:39.091255 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abba9e49-5969-4205-9245-164fcc229fd2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:39.092500 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abba9e49-5969-4205-9245-164fcc229fd2 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:39.115166 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 280/568] 10.222.0.70 () {56 vars in 1137 bytes} [Fri Aug 19 15:53:38 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:39.115166 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba9e49-5969-4205-9245-164fcc229fd2 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:39.121087 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a6d13-98e9-441e-9ed4-e73e9138c44a None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:39.161332 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9772a1a-23de-4832-a444-5460d1af9a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:39.161996 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9772a1a-23de-4832-a444-5460d1af9a3a None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:39.162213 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9772a1a-23de-4832-a444-5460d1af9a3a None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:39.162475 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9772a1a-23de-4832-a444-5460d1af9a3a None admin] PATH_INFO: `/v3/users` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:39.163208 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9772a1a-23de-4832-a444-5460d1af9a3a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:39.163513 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9772a1a-23de-4832-a444-5460d1af9a3a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:39.164994 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9772a1a-23de-4832-a444-5460d1af9a3a None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:39.186508 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 289/569] 10.222.0.70 () {56 vars in 1139 bytes} [Fri Aug 19 15:53:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:39.187353 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9772a1a-23de-4832-a444-5460d1af9a3a None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:39.231417 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:39.242005 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba9e49-5969-4205-9245-164fcc229fd2 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:39.284506 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f28c17d-ca96-4170-8157-3421b19aa451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:39.285221 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f28c17d-ca96-4170-8157-3421b19aa451 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:39.285454 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f28c17d-ca96-4170-8157-3421b19aa451 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:39.285703 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f28c17d-ca96-4170-8157-3421b19aa451 None admin] PATH_INFO: `/v3/domains` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:39.286337 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f28c17d-ca96-4170-8157-3421b19aa451 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:39.286630 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f28c17d-ca96-4170-8157-3421b19aa451 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:39.288474 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f28c17d-ca96-4170-8157-3421b19aa451 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:39.299305 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:39.308025 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 281/570] 10.222.0.70 () {56 vars in 1109 bytes} [Fri Aug 19 15:53:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:39.308025 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f28c17d-ca96-4170-8157-3421b19aa451 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:39.341285 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9772a1a-23de-4832-a444-5460d1af9a3a None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:39.391313 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197d947-5a4e-4e1c-b54a-045a48a6a412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:39.393066 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197d947-5a4e-4e1c-b54a-045a48a6a412 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:39.393498 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197d947-5a4e-4e1c-b54a-045a48a6a412 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:39.393916 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197d947-5a4e-4e1c-b54a-045a48a6a412 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:39.409789 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5197d947-5a4e-4e1c-b54a-045a48a6a412 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:39.411462 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5197d947-5a4e-4e1c-b54a-045a48a6a412 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:39.424525 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f28c17d-ca96-4170-8157-3421b19aa451 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:39.433517 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-5197d947-5a4e-4e1c-b54a-045a48a6a412 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:39.433517 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:39.433517 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:39.433517 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:39.433517 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:39.433517 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:39.433517 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:39.433517 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:39.433517 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:39.433517 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:39.433517 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:39.433517 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:39.433517 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:53:39.433517 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:53:39.433517 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:53:39.433517 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:53:39.434614 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:39.434614 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:39.434614 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:39.434614 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:39.434614 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:39.434614 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:39.434614 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:39.434614 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:39.434614 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:39.434614 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:39.434614 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:39.434614 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:39.434614 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:39.434614 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:39.434614 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:39.434614 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:39.434614 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:53:39.435508 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:53:39.435508 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:39.435508 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:39.441128 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 290/571] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:53:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:39.441128 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197d947-5a4e-4e1c-b54a-045a48a6a412 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:39.481333 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa78cd-88ab-4958-a506-aaf4ad5063be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:39.482095 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa78cd-88ab-4958-a506-aaf4ad5063be None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:39.482327 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa78cd-88ab-4958-a506-aaf4ad5063be None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:39.482597 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa78cd-88ab-4958-a506-aaf4ad5063be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:39.498342 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aa78cd-88ab-4958-a506-aaf4ad5063be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:39.500467 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aa78cd-88ab-4958-a506-aaf4ad5063be None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:39.521140 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-55aa78cd-88ab-4958-a506-aaf4ad5063be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:39.521140 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:39.521140 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:39.521140 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:39.521140 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:39.521140 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:39.521140 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:39.521140 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:39.521140 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:39.521140 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:39.521140 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:39.521140 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:39.521140 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:53:39.521140 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:53:39.521140 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:53:39.521140 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:53:39.522442 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:39.522442 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:39.522442 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:39.522442 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:39.522442 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:39.522442 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:39.522442 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:39.522442 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:39.522442 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:39.522442 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:39.522442 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:39.522442 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:39.522442 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:39.522442 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:39.522442 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:39.522442 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:39.522442 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:53:39.523327 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:53:39.523327 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:39.523327 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:53:39.523327 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 282/572] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:53:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:39.523548 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa78cd-88ab-4958-a506-aaf4ad5063be None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:39.545236 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:39.559120 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197d947-5a4e-4e1c-b54a-045a48a6a412 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:39.599410 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:39.601788 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f2f10-27b5-4232-94a5-d79de77dabd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:39.602774 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f2f10-27b5-4232-94a5-d79de77dabd4 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:39.603219 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f2f10-27b5-4232-94a5-d79de77dabd4 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:39.603613 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f2f10-27b5-4232-94a5-d79de77dabd4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:39.611216 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f2f10-27b5-4232-94a5-d79de77dabd4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:39.612615 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f2f10-27b5-4232-94a5-d79de77dabd4 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:39.626796 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-037f2f10-27b5-4232-94a5-d79de77dabd4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:53:39.626796 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:39.626796 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:39.626796 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:39.626796 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:39.626796 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:39.626796 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:39.626796 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:39.626796 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:39.626796 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:39.626796 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:39.626796 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:39.626796 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 15:53:39.626796 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 15:53:39.626796 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 15:53:39.633250 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 15:53:39.633250 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:39.633250 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:39.633250 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:39.633250 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:39.633250 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:39.633250 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:39.633250 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:39.633250 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:39.633250 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:39.633250 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:39.633250 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:39.633250 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:39.633250 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:39.633250 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:39.633250 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:39.633250 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:39.634332 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 15:53:39.634332 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 15:53:39.634332 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 15:53:39.634332 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 15:53:39.634332 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 15:53:39.634332 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 15:53:39.634332 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:53:39.634332 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:39.634332 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 291/573] 10.222.0.70 () {56 vars in 1111 bytes} [Fri Aug 19 15:53:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:39.634332 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f2f10-27b5-4232-94a5-d79de77dabd4 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:39.663960 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa78cd-88ab-4958-a506-aaf4ad5063be None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:39.712119 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae454f8e-5338-4dbe-aa04-d0d33e848847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:39.713000 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae454f8e-5338-4dbe-aa04-d0d33e848847 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:39.713949 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae454f8e-5338-4dbe-aa04-d0d33e848847 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:39.714067 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae454f8e-5338-4dbe-aa04-d0d33e848847 None admin] PATH_INFO: `/v3/domains` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:39.714795 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae454f8e-5338-4dbe-aa04-d0d33e848847 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:39.715247 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae454f8e-5338-4dbe-aa04-d0d33e848847 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:39.716680 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae454f8e-5338-4dbe-aa04-d0d33e848847 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:39.735619 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 283/574] 10.222.0.70 () {56 vars in 1109 bytes} [Fri Aug 19 15:53:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:39.737597 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae454f8e-5338-4dbe-aa04-d0d33e848847 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:39.762036 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f2f10-27b5-4232-94a5-d79de77dabd4 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:39.809292 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022981c-6f13-4f20-97c0-bef6177097bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:39.809292 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022981c-6f13-4f20-97c0-bef6177097bf None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:39.809606 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022981c-6f13-4f20-97c0-bef6177097bf None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:39.809803 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022981c-6f13-4f20-97c0-bef6177097bf None admin] PATH_INFO: `/v3/domains` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:39.810432 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022981c-6f13-4f20-97c0-bef6177097bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:39.810736 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022981c-6f13-4f20-97c0-bef6177097bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:39.812117 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022981c-6f13-4f20-97c0-bef6177097bf None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:39.827020 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 292/575] 10.222.0.70 () {56 vars in 1109 bytes} [Fri Aug 19 15:53:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:39.827984 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022981c-6f13-4f20-97c0-bef6177097bf None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:39.841635 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:39.870260 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae454f8e-5338-4dbe-aa04-d0d33e848847 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:39.885990 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:39.908216 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a01b82-31c6-4670-a6bd-a3db425c6212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:39.908883 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a01b82-31c6-4670-a6bd-a3db425c6212 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:39.909159 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a01b82-31c6-4670-a6bd-a3db425c6212 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:39.909426 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a01b82-31c6-4670-a6bd-a3db425c6212 None admin] PATH_INFO: `/v3/projects` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:39.910241 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a01b82-31c6-4670-a6bd-a3db425c6212 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:39.910513 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a01b82-31c6-4670-a6bd-a3db425c6212 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:39.911929 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a01b82-31c6-4670-a6bd-a3db425c6212 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:39.925372 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 284/576] 10.222.0.70 () {56 vars in 1148 bytes} [Fri Aug 19 15:53:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:39.926200 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a01b82-31c6-4670-a6bd-a3db425c6212 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:39.948022 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022981c-6f13-4f20-97c0-bef6177097bf None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:39.987587 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971013ad-fad8-464c-b5e0-8ae71d0474ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:39.988238 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971013ad-fad8-464c-b5e0-8ae71d0474ab None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:39.988616 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971013ad-fad8-464c-b5e0-8ae71d0474ab None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:39.988919 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971013ad-fad8-464c-b5e0-8ae71d0474ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:39.997741 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971013ad-fad8-464c-b5e0-8ae71d0474ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:39.999296 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971013ad-fad8-464c-b5e0-8ae71d0474ab None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:40.012131 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-971013ad-fad8-464c-b5e0-8ae71d0474ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:53:40.012131 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:40.012131 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:40.012131 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:40.012131 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:40.012131 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:40.012131 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:40.012131 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:40.012131 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:40.012131 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:40.012131 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:40.012131 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:40.012131 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 15:53:40.012131 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 15:53:40.012131 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 15:53:40.013098 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 15:53:40.013098 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:40.013098 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:40.013098 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:40.013098 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:40.013098 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:40.013098 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:40.013098 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:40.013098 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:40.013098 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:40.013098 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:40.013098 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:40.013098 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:40.013098 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:40.013098 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:40.013098 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:40.013098 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:40.014207 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 15:53:40.014207 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 15:53:40.014207 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 15:53:40.014207 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 15:53:40.014207 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 15:53:40.014207 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 15:53:40.014207 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:53:40.014207 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:40.014207 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 293/577] 10.222.0.70 () {56 vars in 1111 bytes} [Fri Aug 19 15:53:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:40.014207 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971013ad-fad8-464c-b5e0-8ae71d0474ab None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:40.046359 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a01b82-31c6-4670-a6bd-a3db425c6212 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:40.083594 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2569d75-d8a5-46b6-a278-396c71e26608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:40.084214 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2569d75-d8a5-46b6-a278-396c71e26608 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:40.084485 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2569d75-d8a5-46b6-a278-396c71e26608 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:40.084796 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2569d75-d8a5-46b6-a278-396c71e26608 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:40.086822 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:40.093378 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2569d75-d8a5-46b6-a278-396c71e26608 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:40.094811 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2569d75-d8a5-46b6-a278-396c71e26608 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:40.108124 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-a2569d75-d8a5-46b6-a278-396c71e26608 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:53:40.108124 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:40.108124 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:40.108124 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:40.108124 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:40.108124 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:40.108124 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:40.108124 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:40.108124 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:40.108124 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:40.108124 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:40.108124 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:40.108124 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 15:53:40.108124 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 15:53:40.108124 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 15:53:40.109142 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 15:53:40.109142 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:40.109142 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:40.109142 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:40.109142 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:40.109142 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:40.109142 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:40.109142 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:40.109142 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:40.109142 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:40.109142 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:40.109142 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:40.109142 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:40.109142 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:40.109142 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:40.109142 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:40.109142 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:40.110012 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 15:53:40.110012 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 15:53:40.110012 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 15:53:40.110012 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 15:53:40.110012 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 15:53:40.110012 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 15:53:40.110012 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:53:40.110012 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:53:40.110012 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 285/578] 10.222.0.70 () {56 vars in 1111 bytes} [Fri Aug 19 15:53:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:40.110620 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2569d75-d8a5-46b6-a278-396c71e26608 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:40.130418 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971013ad-fad8-464c-b5e0-8ae71d0474ab None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:40.150077 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:40.173601 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dece5c-eda1-4560-948e-b66279a2e55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:40.174298 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dece5c-eda1-4560-948e-b66279a2e55f None admin] REQUEST_METHOD: `PUT` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:40.174553 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dece5c-eda1-4560-948e-b66279a2e55f None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:40.174823 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dece5c-eda1-4560-948e-b66279a2e55f None admin] PATH_INFO: `/v3/projects/48fb7e21c6864d30b70ffca9093afec8/users/3d70aff7f0a448bb9a5cc2b78c828590/roles/f082292a9c404c30891116a86c08becd` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:40.195269 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dece5c-eda1-4560-948e-b66279a2e55f None admin] RBAC: Authorizing `identity:create_grant(project_id=48fb7e21c6864d30b70ffca9093afec8, user_id=3d70aff7f0a448bb9a5cc2b78c828590, role_id=f082292a9c404c30891116a86c08becd)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:40.196941 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dece5c-eda1-4560-948e-b66279a2e55f None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:40.232475 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2569d75-d8a5-46b6-a278-396c71e26608 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:40.268270 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c00f5-a032-4f6f-abce-63b5d671fb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:40.268835 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c00f5-a032-4f6f-abce-63b5d671fb08 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:40.269115 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c00f5-a032-4f6f-abce-63b5d671fb08 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:40.269384 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c00f5-a032-4f6f-abce-63b5d671fb08 None admin] PATH_INFO: `/v3/projects` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:40.270274 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 294/579] 10.222.0.70 () {58 vars in 1439 bytes} [Fri Aug 19 15:53:40 2022] PUT /identity/v3/projects/48fb7e21c6864d30b70ffca9093afec8/users/3d70aff7f0a448bb9a5cc2b78c828590/roles/f082292a9c404c30891116a86c08becd => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:53:40.270394 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25c00f5-a032-4f6f-abce-63b5d671fb08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:40.270394 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25c00f5-a032-4f6f-abce-63b5d671fb08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:40.271804 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25c00f5-a032-4f6f-abce-63b5d671fb08 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:40.281764 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dece5c-eda1-4560-948e-b66279a2e55f None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:40.290201 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 286/580] 10.222.0.70 () {56 vars in 1148 bytes} [Fri Aug 19 15:53:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:40.296812 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c00f5-a032-4f6f-abce-63b5d671fb08 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:40.408371 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:40.419320 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c00f5-a032-4f6f-abce-63b5d671fb08 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:40.428279 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dece5c-eda1-4560-948e-b66279a2e55f None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:40.449312 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:40.461480 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b77779-9c9d-4990-be6d-57960301541a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:40.463975 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b77779-9c9d-4990-be6d-57960301541a None admin] REQUEST_METHOD: `PUT` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:40.463975 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b77779-9c9d-4990-be6d-57960301541a None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:40.463975 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b77779-9c9d-4990-be6d-57960301541a None admin] PATH_INFO: `/v3/projects/48fb7e21c6864d30b70ffca9093afec8/users/92eb2988fd86400dacb28eeef921a4b8/roles/f082292a9c404c30891116a86c08becd` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:40.472088 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15547acf-5a0c-443d-a854-b61bfd492f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:40.472735 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15547acf-5a0c-443d-a854-b61bfd492f04 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:40.473260 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15547acf-5a0c-443d-a854-b61bfd492f04 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:40.473542 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15547acf-5a0c-443d-a854-b61bfd492f04 None admin] PATH_INFO: `/v3/projects` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:40.474257 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15547acf-5a0c-443d-a854-b61bfd492f04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:40.474562 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15547acf-5a0c-443d-a854-b61bfd492f04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:40.476050 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15547acf-5a0c-443d-a854-b61bfd492f04 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:40.481323 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b77779-9c9d-4990-be6d-57960301541a None admin] RBAC: Authorizing `identity:create_grant(project_id=48fb7e21c6864d30b70ffca9093afec8, user_id=92eb2988fd86400dacb28eeef921a4b8, role_id=f082292a9c404c30891116a86c08becd)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:40.482831 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b77779-9c9d-4990-be6d-57960301541a None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:40.491221 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 295/581] 10.222.0.70 () {56 vars in 1148 bytes} [Fri Aug 19 15:53:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:40.492495 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e38be-c603-4898-b02a-01db37a2945d None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:40.492826 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e38be-c603-4898-b02a-01db37a2945d None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:40.493097 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e38be-c603-4898-b02a-01db37a2945d None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:40.494342 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 296/582] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:53:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:53:40.497511 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16e38be-c603-4898-b02a-01db37a2945d None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:40.609910 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16e38be-c603-4898-b02a-01db37a2945d None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:40.612408 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 287/583] 10.222.0.70 () {58 vars in 1439 bytes} [Fri Aug 19 15:53:40 2022] PUT /identity/v3/projects/48fb7e21c6864d30b70ffca9093afec8/users/92eb2988fd86400dacb28eeef921a4b8/roles/f082292a9c404c30891116a86c08becd => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:53:40.613781 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a0cb24-b76e-416e-88cd-b9e9077e526f None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:40.614079 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a0cb24-b76e-416e-88cd-b9e9077e526f None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:40.614597 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a0cb24-b76e-416e-88cd-b9e9077e526f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:40.637725 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-a7a0cb24-b76e-416e-88cd-b9e9077e526f None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:53:40.640906 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-a7a0cb24-b76e-416e-88cd-b9e9077e526f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:53:40.667369 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b7364-4e41-496b-a012-620f8fa134a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:40.668056 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b7364-4e41-496b-a012-620f8fa134a5 None admin] REQUEST_METHOD: `PUT` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:40.668331 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b7364-4e41-496b-a012-620f8fa134a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:40.668602 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b7364-4e41-496b-a012-620f8fa134a5 None admin] PATH_INFO: `/v3/projects/48fb7e21c6864d30b70ffca9093afec8/users/f5593ee9d30b4b65a215a4fe8dfba060/roles/f082292a9c404c30891116a86c08becd` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:40.696751 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7b7364-4e41-496b-a012-620f8fa134a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=48fb7e21c6864d30b70ffca9093afec8, user_id=f5593ee9d30b4b65a215a4fe8dfba060, role_id=f082292a9c404c30891116a86c08becd)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:40.698856 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7b7364-4e41-496b-a012-620f8fa134a5 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:40.744080 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 288/584] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:53:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:53:40.807267 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 297/585] 10.222.0.70 () {58 vars in 1439 bytes} [Fri Aug 19 15:53:40 2022] PUT /identity/v3/projects/48fb7e21c6864d30b70ffca9093afec8/users/f5593ee9d30b4b65a215a4fe8dfba060/roles/f082292a9c404c30891116a86c08becd => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:53:41.101201 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a0cb24-b76e-416e-88cd-b9e9077e526f None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:41.177487 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:41.210288 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a0cb24-b76e-416e-88cd-b9e9077e526f None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:41.249860 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6fc6b-d8e1-41fb-af96-c469beffb6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:41.250870 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6fc6b-d8e1-41fb-af96-c469beffb6bb None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:41.251355 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6fc6b-d8e1-41fb-af96-c469beffb6bb None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:41.251888 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6fc6b-d8e1-41fb-af96-c469beffb6bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:41.264677 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d6fc6b-d8e1-41fb-af96-c469beffb6bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:53:41.269732 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-31d6fc6b-d8e1-41fb-af96-c469beffb6bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:53:41.269732 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:41.269732 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:41.269732 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:41.269732 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:41.269732 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:41.269732 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:41.269732 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:41.269732 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:41.269732 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:41.269732 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:41.269732 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:41.269732 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:53:41.269732 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:53:41.269732 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:53:41.269732 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:53:41.270650 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:53:41.270650 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:53:41.270650 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:53:41.270650 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:53:41.270650 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:41.270650 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:41.270650 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:41.270650 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:41.270650 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:41.270650 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:41.270650 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:41.270650 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:41.270650 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:41.270650 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:41.270650 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:41.270650 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:41.271473 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:41.271473 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:41.271473 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:41.271473 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:41.271473 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:53:41.271473 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:53:41.271473 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:53:41.271473 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:53:41.271473 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:53:41.271473 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:53:41.271473 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:53:41.271473 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:53:41.275848 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 289/586] 10.222.0.70 () {56 vars in 1102 bytes} [Fri Aug 19 15:53:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:41.281541 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b7364-4e41-496b-a012-620f8fa134a5 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:41.311664 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:41.413889 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b7364-4e41-496b-a012-620f8fa134a5 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:41.452036 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713fdf22-3de0-4f5f-9ccb-e279446c1f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:41.452935 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fdf22-3de0-4f5f-9ccb-e279446c1f2d None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:41.453387 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fdf22-3de0-4f5f-9ccb-e279446c1f2d None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:41.453804 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fdf22-3de0-4f5f-9ccb-e279446c1f2d None admin] PATH_INFO: `/v3/roles` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:41.454622 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713fdf22-3de0-4f5f-9ccb-e279446c1f2d None admin] RBAC: Adding query filter params (name=service) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:41.455069 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713fdf22-3de0-4f5f-9ccb-e279446c1f2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:41.456697 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713fdf22-3de0-4f5f-9ccb-e279446c1f2d None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:41.467875 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 298/587] 10.222.0.70 () {56 vars in 1103 bytes} [Fri Aug 19 15:53:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:41.473886 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6fc6b-d8e1-41fb-af96-c469beffb6bb None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:41.603153 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6fc6b-d8e1-41fb-af96-c469beffb6bb None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:41.636028 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:41.641811 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af51ab77-1fe4-4247-ace2-37ea7aceaa8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:41.646964 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51ab77-1fe4-4247-ace2-37ea7aceaa8f None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:41.646964 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51ab77-1fe4-4247-ace2-37ea7aceaa8f None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:41.646964 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51ab77-1fe4-4247-ace2-37ea7aceaa8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:41.655176 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af51ab77-1fe4-4247-ace2-37ea7aceaa8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:41.656914 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af51ab77-1fe4-4247-ace2-37ea7aceaa8f None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:41.672412 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-af51ab77-1fe4-4247-ace2-37ea7aceaa8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:41.672412 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:41.672412 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:41.672412 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:41.672412 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:41.672412 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:41.672412 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:41.672412 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:41.672412 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:41.672412 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:41.672412 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:41.672412 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:41.672412 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:53:41.672412 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:53:41.672412 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:53:41.672412 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:53:41.673583 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:41.673583 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:41.673583 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:41.673583 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:41.673583 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:41.673583 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:41.673583 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:41.673583 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:41.673583 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:41.673583 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:41.673583 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:41.673583 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:41.673583 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:41.673583 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:41.673583 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:41.673583 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:41.673583 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:53:41.674631 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:53:41.674631 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:41.674631 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:53:41.676407 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 290/588] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:53:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:41.683908 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713fdf22-3de0-4f5f-9ccb-e279446c1f2d None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:41.785762 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:41.797701 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713fdf22-3de0-4f5f-9ccb-e279446c1f2d None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:41.834157 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01280181-73e0-44c4-b0b3-4d14178b94d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:41.835034 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01280181-73e0-44c4-b0b3-4d14178b94d5 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:41.835535 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01280181-73e0-44c4-b0b3-4d14178b94d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:41.835959 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01280181-73e0-44c4-b0b3-4d14178b94d5 None admin] PATH_INFO: `/v3/domains` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:41.836825 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01280181-73e0-44c4-b0b3-4d14178b94d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:41.837494 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01280181-73e0-44c4-b0b3-4d14178b94d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:41.839569 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01280181-73e0-44c4-b0b3-4d14178b94d5 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:41.859928 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af51ab77-1fe4-4247-ace2-37ea7aceaa8f None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:41.860592 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 299/589] 10.222.0.70 () {56 vars in 1109 bytes} [Fri Aug 19 15:53:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:41.970161 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af51ab77-1fe4-4247-ace2-37ea7aceaa8f None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:42.008702 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ca169-b5e2-4eaa-b89c-2bc132f49f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:42.009701 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ca169-b5e2-4eaa-b89c-2bc132f49f39 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:42.010153 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ca169-b5e2-4eaa-b89c-2bc132f49f39 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:42.010573 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ca169-b5e2-4eaa-b89c-2bc132f49f39 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:42.019473 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2ca169-b5e2-4eaa-b89c-2bc132f49f39 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:42.021186 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2ca169-b5e2-4eaa-b89c-2bc132f49f39 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:42.033978 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-3b2ca169-b5e2-4eaa-b89c-2bc132f49f39 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 15:53:42.033978 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:42.033978 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:42.033978 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:42.033978 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:42.033978 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:42.033978 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:42.033978 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:42.033978 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:42.033978 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:42.033978 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:42.033978 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:42.033978 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 15:53:42.033978 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 15:53:42.033978 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 15:53:42.033978 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 15:53:42.035200 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:42.035200 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:42.035200 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 15:53:42.035200 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:53:42.035200 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 15:53:42.035200 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:53:42.035200 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:42.035200 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:42.035200 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:42.035200 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:42.035200 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:42.035200 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:42.035200 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:42.035200 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:42.035200 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:42.035200 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:42.035200 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:42.035200 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:42.036385 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:42.036385 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:42.036385 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 15:53:42.036385 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 15:53:42.036385 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 15:53:42.036385 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 15:53:42.036385 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 15:53:42.036385 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 15:53:42.036385 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 15:53:42.036385 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:53:42.039387 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 291/590] 10.222.0.70 () {56 vars in 1093 bytes} [Fri Aug 19 15:53:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:42.046120 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01280181-73e0-44c4-b0b3-4d14178b94d5 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:42.155848 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01280181-73e0-44c4-b0b3-4d14178b94d5 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:42.193265 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb1382-db25-47a2-8427-3e1653a2923e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:42.194128 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb1382-db25-47a2-8427-3e1653a2923e None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:42.194550 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb1382-db25-47a2-8427-3e1653a2923e None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:42.194989 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb1382-db25-47a2-8427-3e1653a2923e None admin] PATH_INFO: `/v3/users` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:42.195933 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeb1382-db25-47a2-8427-3e1653a2923e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:42.196378 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeb1382-db25-47a2-8427-3e1653a2923e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:42.199261 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeb1382-db25-47a2-8427-3e1653a2923e None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:42.219483 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 300/591] 10.222.0.70 () {56 vars in 1133 bytes} [Fri Aug 19 15:53:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:42.225493 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ca169-b5e2-4eaa-b89c-2bc132f49f39 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:42.276839 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:42.340108 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ca169-b5e2-4eaa-b89c-2bc132f49f39 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:42.380960 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f775c4f-41f3-4fd9-8d2d-3b21782682df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:42.381580 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f775c4f-41f3-4fd9-8d2d-3b21782682df None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:42.381863 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f775c4f-41f3-4fd9-8d2d-3b21782682df None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:42.382140 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f775c4f-41f3-4fd9-8d2d-3b21782682df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:42.459938 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f775c4f-41f3-4fd9-8d2d-3b21782682df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:42.461442 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f775c4f-41f3-4fd9-8d2d-3b21782682df None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:42.526240 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:42.582771 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 292/592] 10.222.0.70 () {58 vars in 1282 bytes} [Fri Aug 19 15:53:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:53:42.589034 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb1382-db25-47a2-8427-3e1653a2923e None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:42.600649 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:42.653157 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7fc99f-e3a6-4e31-b734-102009697c49 None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:42.653491 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7fc99f-e3a6-4e31-b734-102009697c49 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:42.653717 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7fc99f-e3a6-4e31-b734-102009697c49 None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:42.655432 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 293/593] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:53:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 15:53:42.660856 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9352e38-6e31-4b1a-b2d8-4bcfe6ffe104 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:42.661137 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9352e38-6e31-4b1a-b2d8-4bcfe6ffe104 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:42.661414 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9352e38-6e31-4b1a-b2d8-4bcfe6ffe104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:42.680709 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-f9352e38-6e31-4b1a-b2d8-4bcfe6ffe104 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:53:42.682160 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-f9352e38-6e31-4b1a-b2d8-4bcfe6ffe104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:53:42.709232 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb1382-db25-47a2-8427-3e1653a2923e None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:42.753028 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78bf1e5-47cf-4f8d-8fda-deb518ef7b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:42.753838 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78bf1e5-47cf-4f8d-8fda-deb518ef7b49 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:42.754248 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78bf1e5-47cf-4f8d-8fda-deb518ef7b49 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:42.754523 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78bf1e5-47cf-4f8d-8fda-deb518ef7b49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:42.768216 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78bf1e5-47cf-4f8d-8fda-deb518ef7b49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:42.769759 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78bf1e5-47cf-4f8d-8fda-deb518ef7b49 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:42.772902 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 294/594] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:53:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 15:53:42.790959 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-f78bf1e5-47cf-4f8d-8fda-deb518ef7b49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:42.790959 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:42.790959 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:42.790959 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:42.790959 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:42.790959 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:42.790959 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:42.790959 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:42.790959 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:42.790959 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:42.790959 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:42.790959 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:42.790959 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:53:42.790959 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:53:42.790959 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:53:42.790959 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:53:42.792120 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:42.792120 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:42.792120 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:42.792120 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:42.792120 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:42.792120 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:42.792120 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:42.792120 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:42.792120 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:42.792120 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:42.792120 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:42.792120 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:42.792120 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:42.792120 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:42.792120 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:42.792120 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:42.792120 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:53:42.793045 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:53:42.793045 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:42.793045 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:42.793045 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 301/595] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:53:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:42.798490 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9352e38-6e31-4b1a-b2d8-4bcfe6ffe104 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:42.883056 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:42.910476 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9352e38-6e31-4b1a-b2d8-4bcfe6ffe104 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:42.947290 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d1772-ff4e-46a9-91fe-c5cc1ac3e590 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:42.947812 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d1772-ff4e-46a9-91fe-c5cc1ac3e590 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:42.948086 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d1772-ff4e-46a9-91fe-c5cc1ac3e590 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:42.949710 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 302/596] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:53:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 15:53:42.952569 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4981c97e-d5d7-4d18-b8ec-10bf1d5b41d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:42.953384 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981c97e-d5d7-4d18-b8ec-10bf1d5b41d5 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:42.953671 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981c97e-d5d7-4d18-b8ec-10bf1d5b41d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:42.953944 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981c97e-d5d7-4d18-b8ec-10bf1d5b41d5 None admin] PATH_INFO: `/v3/domains` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:42.954594 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4981c97e-d5d7-4d18-b8ec-10bf1d5b41d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:42.954895 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4981c97e-d5d7-4d18-b8ec-10bf1d5b41d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:42.956256 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4981c97e-d5d7-4d18-b8ec-10bf1d5b41d5 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:42.961247 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0abf57-664b-4703-99ab-1215f4c91a45 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:42.961779 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0abf57-664b-4703-99ab-1215f4c91a45 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:42.962250 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0abf57-664b-4703-99ab-1215f4c91a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:42.971010 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 295/597] 10.222.0.70 () {56 vars in 1109 bytes} [Fri Aug 19 15:53:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:42.976189 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4981c97e-d5d7-4d18-b8ec-10bf1d5b41d5 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:42.989930 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-9b0abf57-664b-4703-99ab-1215f4c91a45 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:53:42.991502 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-9b0abf57-664b-4703-99ab-1215f4c91a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:53:43.067330 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:43.093348 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 303/598] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:53:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:53:43.115443 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0abf57-664b-4703-99ab-1215f4c91a45 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:43.130015 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4981c97e-d5d7-4d18-b8ec-10bf1d5b41d5 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:43.184059 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed94d4e7-f2cc-4c27-a422-30f07b81db91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:43.185570 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94d4e7-f2cc-4c27-a422-30f07b81db91 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:43.186308 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94d4e7-f2cc-4c27-a422-30f07b81db91 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:43.186877 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94d4e7-f2cc-4c27-a422-30f07b81db91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:43.190138 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:43.199893 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed94d4e7-f2cc-4c27-a422-30f07b81db91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:43.201646 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed94d4e7-f2cc-4c27-a422-30f07b81db91 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:43.215024 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-ed94d4e7-f2cc-4c27-a422-30f07b81db91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:53:43.215024 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:43.215024 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:43.215024 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:43.215024 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:43.215024 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:43.215024 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:43.215024 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:43.215024 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:43.215024 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:43.215024 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:43.215024 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:43.215024 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 15:53:43.215024 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 15:53:43.215024 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 15:53:43.216168 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 15:53:43.216168 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:43.216168 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:43.216168 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:43.216168 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:43.216168 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:43.216168 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:43.216168 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:43.216168 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:43.216168 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:43.216168 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:43.216168 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:43.216168 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:43.216168 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:43.216168 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:43.216168 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:43.216168 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:43.217292 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 15:53:43.217292 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 15:53:43.217292 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 15:53:43.217292 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 15:53:43.217292 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 15:53:43.217292 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 15:53:43.217292 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:53:43.217292 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:53:43.219447 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 296/599] 10.222.0.70 () {56 vars in 1111 bytes} [Fri Aug 19 15:53:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:53:43.227997 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed94d4e7-f2cc-4c27-a422-30f07b81db91 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:43.249262 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0abf57-664b-4703-99ab-1215f4c91a45 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:43.295027 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96559ee-ea20-4fcc-b411-c6398ddb6544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:43.295676 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96559ee-ea20-4fcc-b411-c6398ddb6544 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:43.296003 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96559ee-ea20-4fcc-b411-c6398ddb6544 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:43.296279 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96559ee-ea20-4fcc-b411-c6398ddb6544 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:43.308725 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96559ee-ea20-4fcc-b411-c6398ddb6544 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:53:43.313439 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-c96559ee-ea20-4fcc-b411-c6398ddb6544 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:53:43.313439 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:43.313439 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:43.313439 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:43.313439 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:43.313439 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:43.313439 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:43.313439 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:43.313439 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:43.313439 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:43.313439 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:43.313439 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:43.313439 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:53:43.313439 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:53:43.313439 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:53:43.313439 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:53:43.314533 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:53:43.314533 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:53:43.314533 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:53:43.314533 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:53:43.314533 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:43.314533 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:43.314533 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:43.314533 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:43.314533 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:43.314533 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:43.314533 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:43.314533 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:43.314533 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:43.314533 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:43.314533 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:43.314533 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:43.315448 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:43.315448 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:43.315448 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:43.315448 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:43.315448 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:53:43.315448 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:53:43.315448 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:53:43.315448 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:53:43.315448 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:53:43.315448 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:53:43.315448 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:53:43.315448 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:43.315448 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 304/600] 10.222.0.70 () {56 vars in 1102 bytes} [Fri Aug 19 15:53:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:43.316247 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360a9ff-5795-41b7-8035-23e8e151413b None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:43.316329 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360a9ff-5795-41b7-8035-23e8e151413b None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:43.316539 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360a9ff-5795-41b7-8035-23e8e151413b None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:43.317998 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 305/601] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:53:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:53:43.320075 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d360a9ff-5795-41b7-8035-23e8e151413b None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:43.378717 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed94d4e7-f2cc-4c27-a422-30f07b81db91 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:43.382881 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:43.427696 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a5373-f64f-4016-a9b6-1517971951e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:43.428307 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a5373-f64f-4016-a9b6-1517971951e1 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:43.428583 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a5373-f64f-4016-a9b6-1517971951e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:43.428913 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a5373-f64f-4016-a9b6-1517971951e1 None admin] PATH_INFO: `/v3/projects` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:43.429571 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817a5373-f64f-4016-a9b6-1517971951e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:43.429869 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817a5373-f64f-4016-a9b6-1517971951e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:43.431569 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817a5373-f64f-4016-a9b6-1517971951e1 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:43.445335 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d360a9ff-5795-41b7-8035-23e8e151413b None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:43.446591 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 297/602] 10.222.0.70 () {56 vars in 1148 bytes} [Fri Aug 19 15:53:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:43.450217 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8814b18-9127-4739-8a4a-9dd626b57b67 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:43.450747 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8814b18-9127-4739-8a4a-9dd626b57b67 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:43.451901 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8814b18-9127-4739-8a4a-9dd626b57b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:43.480384 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-a8814b18-9127-4739-8a4a-9dd626b57b67 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:53:43.481626 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-a8814b18-9127-4739-8a4a-9dd626b57b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:53:43.486207 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90c6dc-a6d4-4112-8c6b-aef8d8e4bc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:43.486809 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90c6dc-a6d4-4112-8c6b-aef8d8e4bc15 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:43.487080 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90c6dc-a6d4-4112-8c6b-aef8d8e4bc15 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:43.487344 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90c6dc-a6d4-4112-8c6b-aef8d8e4bc15 None admin] PATH_INFO: `/v3/roles` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:43.488001 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db90c6dc-a6d4-4112-8c6b-aef8d8e4bc15 None admin] RBAC: Adding query filter params (name=service) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:43.488293 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db90c6dc-a6d4-4112-8c6b-aef8d8e4bc15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:43.489680 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db90c6dc-a6d4-4112-8c6b-aef8d8e4bc15 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:43.501636 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 306/603] 10.222.0.70 () {56 vars in 1103 bytes} [Fri Aug 19 15:53:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:43.502488 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90c6dc-a6d4-4112-8c6b-aef8d8e4bc15 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:43.544980 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:43.562985 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 298/604] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:53:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:53:43.563849 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8814b18-9127-4739-8a4a-9dd626b57b67 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:43.610742 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90c6dc-a6d4-4112-8c6b-aef8d8e4bc15 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:43.625863 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:43.660251 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698307a0-acb4-44c2-adf4-0af2dd6ebde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:43.662847 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698307a0-acb4-44c2-adf4-0af2dd6ebde7 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:43.663124 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698307a0-acb4-44c2-adf4-0af2dd6ebde7 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:43.663400 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698307a0-acb4-44c2-adf4-0af2dd6ebde7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:43.664123 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698307a0-acb4-44c2-adf4-0af2dd6ebde7 None admin] RBAC: Adding query filter params (role.id=f082292a9c404c30891116a86c08becd, scope.project.id=48fb7e21c6864d30b70ffca9093afec8, user.id=d90cec9e3ff64b5aa4cc867895b996ad) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:43.664427 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698307a0-acb4-44c2-adf4-0af2dd6ebde7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:43.666049 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698307a0-acb4-44c2-adf4-0af2dd6ebde7 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:43.680702 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 307/605] 10.222.0.70 () {56 vars in 1374 bytes} [Fri Aug 19 15:53:43 2022] GET /identity/v3/role_assignments?user.id=d90cec9e3ff64b5aa4cc867895b996ad&scope.project.id=48fb7e21c6864d30b70ffca9093afec8&role.id=f082292a9c404c30891116a86c08becd => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:43.680702 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698307a0-acb4-44c2-adf4-0af2dd6ebde7 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:43.698178 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8814b18-9127-4739-8a4a-9dd626b57b67 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:43.740447 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f64a6d5-1dc9-4eed-b955-252b2f219e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:43.741261 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64a6d5-1dc9-4eed-b955-252b2f219e03 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:43.741609 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64a6d5-1dc9-4eed-b955-252b2f219e03 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:43.741952 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64a6d5-1dc9-4eed-b955-252b2f219e03 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:43.755626 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f64a6d5-1dc9-4eed-b955-252b2f219e03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:53:43.761554 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-4f64a6d5-1dc9-4eed-b955-252b2f219e03 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:53:43.761554 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:43.761554 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:43.761554 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:43.761554 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:43.761554 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:43.761554 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:43.761554 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:43.761554 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:43.761554 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:43.761554 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:43.761554 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:43.761554 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:53:43.761554 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:53:43.761554 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:53:43.761554 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:53:43.762564 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:53:43.762564 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:53:43.762564 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:53:43.762564 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:53:43.762564 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:43.762564 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:43.762564 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:43.762564 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:43.762564 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:43.762564 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:43.762564 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:43.762564 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:43.762564 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:43.762564 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:43.762564 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:43.762564 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:43.763401 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:43.763401 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:43.763401 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:43.763401 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:43.763401 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:53:43.763401 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:53:43.763401 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:53:43.763401 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:53:43.763401 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:53:43.763401 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:53:43.763401 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:53:43.763401 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:53:43.763401 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 299/606] 10.222.0.70 () {56 vars in 1102 bytes} [Fri Aug 19 15:53:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:43.768634 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f64a6d5-1dc9-4eed-b955-252b2f219e03 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:43.830797 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698307a0-acb4-44c2-adf4-0af2dd6ebde7 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:43.840870 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:43.872181 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd060205-56be-4d8d-b34b-318e0f7cb4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:43.872943 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd060205-56be-4d8d-b34b-318e0f7cb4b9 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:43.873340 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd060205-56be-4d8d-b34b-318e0f7cb4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:43.874235 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd060205-56be-4d8d-b34b-318e0f7cb4b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:43.892729 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd060205-56be-4d8d-b34b-318e0f7cb4b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:43.895384 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd060205-56be-4d8d-b34b-318e0f7cb4b9 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:43.913782 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-fd060205-56be-4d8d-b34b-318e0f7cb4b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:43.913782 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:43.913782 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:43.913782 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:43.913782 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:43.913782 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:43.913782 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:43.913782 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:43.913782 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:43.913782 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:43.913782 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:43.913782 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:43.913782 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:53:43.913782 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:53:43.913782 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:53:43.913782 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:53:43.914907 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:43.914907 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:43.914907 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:43.914907 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:43.914907 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:43.914907 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:43.914907 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:43.914907 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:43.914907 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:43.914907 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:43.914907 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:43.914907 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:43.914907 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:43.914907 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:43.914907 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:43.914907 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:43.914907 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:53:43.916458 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:53:43.916458 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:43.916458 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:43.916458 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 308/607] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:53:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:43.916458 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd060205-56be-4d8d-b34b-318e0f7cb4b9 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:43.924066 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f64a6d5-1dc9-4eed-b955-252b2f219e03 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:43.952362 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:43.970321 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8274a2-86de-496d-8119-77c04dc17057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:43.970893 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8274a2-86de-496d-8119-77c04dc17057 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:43.971173 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8274a2-86de-496d-8119-77c04dc17057 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:43.971447 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8274a2-86de-496d-8119-77c04dc17057 None admin] PATH_INFO: `/v3/roles` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:43.972243 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8274a2-86de-496d-8119-77c04dc17057 None admin] RBAC: Adding query filter params (name=service) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:43.972421 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8274a2-86de-496d-8119-77c04dc17057 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:43.974783 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8274a2-86de-496d-8119-77c04dc17057 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:43.983885 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 300/608] 10.222.0.70 () {56 vars in 1103 bytes} [Fri Aug 19 15:53:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:53:43.984947 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8274a2-86de-496d-8119-77c04dc17057 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:44.043996 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd060205-56be-4d8d-b34b-318e0f7cb4b9 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:44.081823 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44127175-cc23-46f1-8f65-0a9368104c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:44.082463 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44127175-cc23-46f1-8f65-0a9368104c5f None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:44.082739 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44127175-cc23-46f1-8f65-0a9368104c5f None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:44.083013 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44127175-cc23-46f1-8f65-0a9368104c5f None admin] PATH_INFO: `/v3/roles/service` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:44.094829 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44127175-cc23-46f1-8f65-0a9368104c5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:53:44.100043 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-44127175-cc23-46f1-8f65-0a9368104c5f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:53:44.100043 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:44.100043 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:44.100043 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:44.100043 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:44.100043 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:44.100043 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:44.100043 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:44.100043 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:44.100043 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:44.100043 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:44.100043 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:44.100043 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:53:44.100043 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:53:44.100043 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:53:44.100043 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:53:44.101144 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:53:44.101144 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:53:44.101144 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:53:44.101144 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:53:44.101144 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:44.101144 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:44.101144 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:44.101144 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:44.101144 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:44.101144 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:44.101144 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:44.101144 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:44.101144 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:44.101144 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:44.101144 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:44.101144 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:44.101991 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:44.101991 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:44.101991 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:44.101991 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:44.101991 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:53:44.101991 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:53:44.101991 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:53:44.101991 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:53:44.101991 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:53:44.101991 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:53:44.101991 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:53:44.101991 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:44.101991 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 309/609] 10.222.0.70 () {56 vars in 1102 bytes} [Fri Aug 19 15:53:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:44.102678 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44127175-cc23-46f1-8f65-0a9368104c5f None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:44.122170 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8274a2-86de-496d-8119-77c04dc17057 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:44.130099 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:44.167538 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee56428-44e3-45aa-ae44-c1df393ace99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:44.168278 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee56428-44e3-45aa-ae44-c1df393ace99 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:44.168574 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee56428-44e3-45aa-ae44-c1df393ace99 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:44.168861 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee56428-44e3-45aa-ae44-c1df393ace99 None admin] PATH_INFO: `/v3/domains` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:44.169515 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee56428-44e3-45aa-ae44-c1df393ace99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:44.169818 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee56428-44e3-45aa-ae44-c1df393ace99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:44.171203 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee56428-44e3-45aa-ae44-c1df393ace99 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:44.184632 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 301/610] 10.222.0.70 () {56 vars in 1109 bytes} [Fri Aug 19 15:53:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:44.189745 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee56428-44e3-45aa-ae44-c1df393ace99 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:44.208588 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:44.229289 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44127175-cc23-46f1-8f65-0a9368104c5f None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:44.270157 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15bdf0-4e84-4cc0-bca2-aefc1c8027f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:44.270766 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15bdf0-4e84-4cc0-bca2-aefc1c8027f0 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:44.271194 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15bdf0-4e84-4cc0-bca2-aefc1c8027f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:44.271473 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15bdf0-4e84-4cc0-bca2-aefc1c8027f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:44.295797 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de15bdf0-4e84-4cc0-bca2-aefc1c8027f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:44.297454 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de15bdf0-4e84-4cc0-bca2-aefc1c8027f0 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:44.313894 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-de15bdf0-4e84-4cc0-bca2-aefc1c8027f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:44.313894 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:44.313894 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:44.313894 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:44.313894 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:44.313894 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:44.313894 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:44.313894 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:44.313894 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:44.313894 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:44.313894 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:44.313894 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:44.313894 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:53:44.313894 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:53:44.313894 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:53:44.313894 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:53:44.314956 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:44.314956 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:44.314956 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:44.314956 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:44.314956 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:44.314956 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:44.314956 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:44.314956 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:44.314956 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:44.314956 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:44.314956 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:44.314956 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:44.314956 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:44.314956 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:44.314956 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:44.314956 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:44.314956 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:53:44.315859 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:53:44.315859 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:44.315859 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:44.316025 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee56428-44e3-45aa-ae44-c1df393ace99 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:44.316097 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 310/611] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:53:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:44.316097 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15bdf0-4e84-4cc0-bca2-aefc1c8027f0 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:44.363052 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0545628d-9901-4fcb-a775-bb25d5a91bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:44.363906 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545628d-9901-4fcb-a775-bb25d5a91bc5 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:44.364230 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545628d-9901-4fcb-a775-bb25d5a91bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:44.364535 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545628d-9901-4fcb-a775-bb25d5a91bc5 None admin] PATH_INFO: `/v3/roles` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:44.366123 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0545628d-9901-4fcb-a775-bb25d5a91bc5 None admin] RBAC: Adding query filter params (name=service) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:44.366423 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0545628d-9901-4fcb-a775-bb25d5a91bc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:44.369825 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0545628d-9901-4fcb-a775-bb25d5a91bc5 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:44.385597 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 302/612] 10.222.0.70 () {56 vars in 1103 bytes} [Fri Aug 19 15:53:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:44.386490 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0545628d-9901-4fcb-a775-bb25d5a91bc5 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:44.427323 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:44.442725 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15bdf0-4e84-4cc0-bca2-aefc1c8027f0 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:44.488654 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a68ab9b-89ac-4c32-8119-83536848a715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:44.488654 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68ab9b-89ac-4c32-8119-83536848a715 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:44.488654 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68ab9b-89ac-4c32-8119-83536848a715 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:44.489054 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68ab9b-89ac-4c32-8119-83536848a715 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:44.497845 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a68ab9b-89ac-4c32-8119-83536848a715 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:44.499294 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a68ab9b-89ac-4c32-8119-83536848a715 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:44.502989 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:44.512566 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-0a68ab9b-89ac-4c32-8119-83536848a715 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 19 15:53:44.512566 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:44.512566 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:44.512566 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:44.512566 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:44.512566 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:44.512566 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:44.512566 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:44.512566 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:44.512566 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:44.512566 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:44.512566 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:44.512566 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 15:53:44.512566 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 15:53:44.512566 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 15:53:44.512566 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 15:53:44.515794 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:44.515794 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:44.515794 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 15:53:44.515794 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:53:44.515794 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 15:53:44.515794 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:53:44.515794 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:44.515794 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:44.515794 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:44.515794 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:44.515794 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:44.515794 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:44.515794 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:44.515794 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:44.515794 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:44.515794 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:44.515794 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:44.515794 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:44.516809 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:44.516809 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:44.516809 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 15:53:44.516809 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 15:53:44.516809 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 15:53:44.516809 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 15:53:44.516809 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 15:53:44.516809 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 15:53:44.516809 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 19 15:53:44.516809 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:44.516809 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 311/613] 10.222.0.70 () {56 vars in 1099 bytes} [Fri Aug 19 15:53:44 2022] GET /identity/v3/users/glance => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:44.516809 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a68ab9b-89ac-4c32-8119-83536848a715 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:44.531235 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0545628d-9901-4fcb-a775-bb25d5a91bc5 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:44.583248 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee10c44e-7ec0-435b-927e-5dfb2d53ab6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:44.583890 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10c44e-7ec0-435b-927e-5dfb2d53ab6c None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:44.584196 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10c44e-7ec0-435b-927e-5dfb2d53ab6c None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:44.584470 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10c44e-7ec0-435b-927e-5dfb2d53ab6c None admin] PATH_INFO: `/v3/domains` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:44.585164 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee10c44e-7ec0-435b-927e-5dfb2d53ab6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:44.585466 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee10c44e-7ec0-435b-927e-5dfb2d53ab6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:44.586825 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee10c44e-7ec0-435b-927e-5dfb2d53ab6c None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:44.605767 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 303/614] 10.222.0.70 () {56 vars in 1109 bytes} [Fri Aug 19 15:53:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:44.606622 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee10c44e-7ec0-435b-927e-5dfb2d53ab6c None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:44.655342 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a68ab9b-89ac-4c32-8119-83536848a715 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:44.705849 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e82b5-2614-45c0-9be8-98d01bb8b571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:44.706598 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e82b5-2614-45c0-9be8-98d01bb8b571 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:44.706879 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e82b5-2614-45c0-9be8-98d01bb8b571 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:44.707153 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e82b5-2614-45c0-9be8-98d01bb8b571 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:44.718676 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50e82b5-2614-45c0-9be8-98d01bb8b571 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:44.720153 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50e82b5-2614-45c0-9be8-98d01bb8b571 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:44.726309 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:44.735414 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-f50e82b5-2614-45c0-9be8-98d01bb8b571 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:44.735414 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:44.735414 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:44.735414 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:44.735414 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:44.735414 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:44.735414 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:44.735414 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:44.735414 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:44.735414 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:44.735414 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:44.735414 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:44.735414 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:53:44.735414 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:53:44.735414 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:53:44.735414 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:53:44.739653 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:44.739653 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:44.739653 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:44.739653 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:44.739653 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:44.739653 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:44.739653 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:44.739653 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:44.739653 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:44.739653 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:44.739653 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:44.739653 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:44.739653 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:44.739653 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:44.739653 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:44.739653 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:44.739653 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:53:44.740536 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:53:44.740536 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:44.740536 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:44.740536 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 312/615] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:53:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:44.740536 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e82b5-2614-45c0-9be8-98d01bb8b571 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:44.745901 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee10c44e-7ec0-435b-927e-5dfb2d53ab6c None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:44.792573 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee0ce94-1948-416c-b2b7-6cc7c417625d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:44.793221 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0ce94-1948-416c-b2b7-6cc7c417625d None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:44.793500 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0ce94-1948-416c-b2b7-6cc7c417625d None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:44.793787 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0ce94-1948-416c-b2b7-6cc7c417625d None admin] PATH_INFO: `/v3/users` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:44.794507 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee0ce94-1948-416c-b2b7-6cc7c417625d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:44.794803 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee0ce94-1948-416c-b2b7-6cc7c417625d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:44.796250 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee0ce94-1948-416c-b2b7-6cc7c417625d None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:44.805093 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:44.818233 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 304/616] 10.222.0.70 () {56 vars in 1137 bytes} [Fri Aug 19 15:53:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:44.818907 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee0ce94-1948-416c-b2b7-6cc7c417625d None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:44.873766 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e82b5-2614-45c0-9be8-98d01bb8b571 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:44.923571 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbb7a4f-2087-4045-a0fe-9f4ffb791f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:44.924150 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb7a4f-2087-4045-a0fe-9f4ffb791f6a None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:44.924424 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb7a4f-2087-4045-a0fe-9f4ffb791f6a None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:44.924714 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb7a4f-2087-4045-a0fe-9f4ffb791f6a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:44.933589 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbb7a4f-2087-4045-a0fe-9f4ffb791f6a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:44.935247 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbb7a4f-2087-4045-a0fe-9f4ffb791f6a None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:44.941294 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee0ce94-1948-416c-b2b7-6cc7c417625d None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:44.947802 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-ebbb7a4f-2087-4045-a0fe-9f4ffb791f6a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 15:53:44.947802 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:44.947802 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:44.947802 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:44.947802 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:44.947802 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:44.947802 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:44.947802 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:44.947802 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:44.947802 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:44.947802 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:44.947802 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:44.947802 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 15:53:44.947802 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 15:53:44.947802 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 15:53:44.947802 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 15:53:44.949113 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:44.949113 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:44.949113 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 15:53:44.949113 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:53:44.949113 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 15:53:44.949113 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:53:44.949113 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:44.949113 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:44.949113 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:44.949113 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:44.949113 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:44.949113 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:44.949113 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:44.949113 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:44.949113 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:44.949113 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:44.949113 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:44.949113 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:44.950075 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:44.950075 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:44.950075 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 15:53:44.950075 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 15:53:44.950075 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 15:53:44.950075 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 15:53:44.950075 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 15:53:44.950075 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 15:53:44.950075 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 15:53:44.950075 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:44.954035 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 313/617] 10.222.0.70 () {56 vars in 1099 bytes} [Fri Aug 19 15:53:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:44.954884 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbb7a4f-2087-4045-a0fe-9f4ffb791f6a None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:44.985800 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2045f5ef-f7de-4d74-b0ba-95cb36a6c132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:44.986409 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045f5ef-f7de-4d74-b0ba-95cb36a6c132 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:44.986685 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045f5ef-f7de-4d74-b0ba-95cb36a6c132 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:44.986951 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045f5ef-f7de-4d74-b0ba-95cb36a6c132 None admin] PATH_INFO: `/v3/domains` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:44.987581 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2045f5ef-f7de-4d74-b0ba-95cb36a6c132 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:44.987878 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2045f5ef-f7de-4d74-b0ba-95cb36a6c132 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:44.989272 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2045f5ef-f7de-4d74-b0ba-95cb36a6c132 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:45.001542 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 305/618] 10.222.0.70 () {56 vars in 1109 bytes} [Fri Aug 19 15:53:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:45.002377 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2045f5ef-f7de-4d74-b0ba-95cb36a6c132 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:45.016249 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:45.086357 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbb7a4f-2087-4045-a0fe-9f4ffb791f6a None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:45.101024 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:45.125659 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2045f5ef-f7de-4d74-b0ba-95cb36a6c132 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:45.127235 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29710436-0417-4f22-8694-3a48d1c65d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:45.128100 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29710436-0417-4f22-8694-3a48d1c65d6b None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:45.128374 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29710436-0417-4f22-8694-3a48d1c65d6b None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:45.128641 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29710436-0417-4f22-8694-3a48d1c65d6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:45.166783 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d3271-02e0-403a-8428-22125fd9d082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:45.167409 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d3271-02e0-403a-8428-22125fd9d082 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:45.167692 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d3271-02e0-403a-8428-22125fd9d082 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:45.167964 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d3271-02e0-403a-8428-22125fd9d082 None admin] PATH_INFO: `/v3/users` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:45.168721 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d3271-02e0-403a-8428-22125fd9d082 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:45.169029 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d3271-02e0-403a-8428-22125fd9d082 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:45.170442 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d3271-02e0-403a-8428-22125fd9d082 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:45.188599 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 306/619] 10.222.0.70 () {56 vars in 1137 bytes} [Fri Aug 19 15:53:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:45.189414 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d3271-02e0-403a-8428-22125fd9d082 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:45.211287 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29710436-0417-4f22-8694-3a48d1c65d6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:45.213533 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29710436-0417-4f22-8694-3a48d1c65d6b None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:45.269318 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:45.325630 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d3271-02e0-403a-8428-22125fd9d082 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:45.355922 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 314/620] 10.222.0.70 () {58 vars in 1282 bytes} [Fri Aug 19 15:53:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:53:45.357386 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29710436-0417-4f22-8694-3a48d1c65d6b None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:45.373543 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:45.378445 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c729b3-ca63-48fb-ae2e-f7e152c76e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:45.379194 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c729b3-ca63-48fb-ae2e-f7e152c76e3e None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:45.379564 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c729b3-ca63-48fb-ae2e-f7e152c76e3e None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:45.379907 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c729b3-ca63-48fb-ae2e-f7e152c76e3e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:45.388826 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c729b3-ca63-48fb-ae2e-f7e152c76e3e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:45.390303 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c729b3-ca63-48fb-ae2e-f7e152c76e3e None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:45.407874 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-c5c729b3-ca63-48fb-ae2e-f7e152c76e3e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 15:53:45.407874 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:45.407874 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:45.407874 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:45.407874 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:45.407874 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:45.407874 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:45.407874 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:45.407874 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:45.407874 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:45.407874 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:45.407874 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:45.407874 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 15:53:45.407874 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 15:53:45.407874 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 15:53:45.407874 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 15:53:45.408926 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:45.408926 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:45.408926 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 15:53:45.408926 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:53:45.408926 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 15:53:45.408926 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:53:45.408926 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:45.408926 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:45.408926 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:45.408926 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:45.408926 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:45.408926 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:45.408926 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:45.408926 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:45.408926 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:45.408926 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:45.408926 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:45.408926 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:45.409924 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:45.409924 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:45.409924 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 15:53:45.409924 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 15:53:45.409924 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 15:53:45.409924 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 15:53:45.409924 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 15:53:45.409924 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 15:53:45.409924 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 15:53:45.409924 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:53:45.409924 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 307/621] 10.222.0.70 () {56 vars in 1102 bytes} [Fri Aug 19 15:53:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:45.410532 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c729b3-ca63-48fb-ae2e-f7e152c76e3e None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:45.495538 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29710436-0417-4f22-8694-3a48d1c65d6b None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:45.529054 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c729b3-ca63-48fb-ae2e-f7e152c76e3e None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:45.539749 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7f02b-1882-4ef7-befa-44f59d13b1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:45.540363 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7f02b-1882-4ef7-befa-44f59d13b1a8 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:45.540644 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7f02b-1882-4ef7-befa-44f59d13b1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:45.540978 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7f02b-1882-4ef7-befa-44f59d13b1a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:45.557140 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:45.569367 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41921267-6201-4306-9936-ca0574414e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:45.569999 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41921267-6201-4306-9936-ca0574414e6e None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:45.570271 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41921267-6201-4306-9936-ca0574414e6e None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:45.570553 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41921267-6201-4306-9936-ca0574414e6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:45.588157 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41921267-6201-4306-9936-ca0574414e6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:45.590056 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41921267-6201-4306-9936-ca0574414e6e None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:45.606659 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-41921267-6201-4306-9936-ca0574414e6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:45.606659 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:45.606659 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:45.606659 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:45.606659 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:45.606659 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:45.606659 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:45.606659 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:45.606659 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:45.606659 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:45.606659 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:45.606659 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:45.606659 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:53:45.606659 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:53:45.606659 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:53:45.606659 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:53:45.607673 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:45.607673 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:45.607673 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:45.607673 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:45.607673 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:45.607673 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:45.607673 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:45.607673 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:45.607673 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:45.607673 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:45.607673 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:45.607673 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:45.607673 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:45.607673 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:45.607673 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:45.607673 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:45.607673 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:53:45.608544 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:53:45.608544 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:45.608544 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:53:45.608544 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 308/622] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:53:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:45.608544 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41921267-6201-4306-9936-ca0574414e6e None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:45.637720 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba7f02b-1882-4ef7-befa-44f59d13b1a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:45.639221 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba7f02b-1882-4ef7-befa-44f59d13b1a8 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:45.658014 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:45.736184 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41921267-6201-4306-9936-ca0574414e6e None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:45.768404 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 315/623] 10.222.0.70 () {58 vars in 1282 bytes} [Fri Aug 19 15:53:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:53:45.769427 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7f02b-1882-4ef7-befa-44f59d13b1a8 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:45.785719 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c779ef8a-1b5b-4717-9b39-c09fc9da4eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:45.786490 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779ef8a-1b5b-4717-9b39-c09fc9da4eb1 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:45.786766 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779ef8a-1b5b-4717-9b39-c09fc9da4eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:45.787036 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779ef8a-1b5b-4717-9b39-c09fc9da4eb1 None admin] PATH_INFO: `/v3/users` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:45.787767 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c779ef8a-1b5b-4717-9b39-c09fc9da4eb1 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:45.788067 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c779ef8a-1b5b-4717-9b39-c09fc9da4eb1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:45.789668 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c779ef8a-1b5b-4717-9b39-c09fc9da4eb1 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:45.811550 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 309/624] 10.222.0.70 () {56 vars in 1139 bytes} [Fri Aug 19 15:53:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:45.812394 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c779ef8a-1b5b-4717-9b39-c09fc9da4eb1 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:45.851420 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:45.892459 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7f02b-1882-4ef7-befa-44f59d13b1a8 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:45.907388 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:45.934139 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcadc7b6-42a1-41d6-8f4f-5534fa4b1803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:45.934773 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcadc7b6-42a1-41d6-8f4f-5534fa4b1803 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:45.935052 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcadc7b6-42a1-41d6-8f4f-5534fa4b1803 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:45.935327 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcadc7b6-42a1-41d6-8f4f-5534fa4b1803 None admin] PATH_INFO: `/v3/domains` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:45.935989 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcadc7b6-42a1-41d6-8f4f-5534fa4b1803 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:45.936293 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcadc7b6-42a1-41d6-8f4f-5534fa4b1803 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:45.936920 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c779ef8a-1b5b-4717-9b39-c09fc9da4eb1 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:45.937753 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcadc7b6-42a1-41d6-8f4f-5534fa4b1803 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:45.953247 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 316/625] 10.222.0.70 () {56 vars in 1109 bytes} [Fri Aug 19 15:53:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:45.954455 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcadc7b6-42a1-41d6-8f4f-5534fa4b1803 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:45.986788 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41100b15-1dd4-4671-b6a9-f56749cccadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:45.987421 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41100b15-1dd4-4671-b6a9-f56749cccadb None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:45.987698 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41100b15-1dd4-4671-b6a9-f56749cccadb None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:45.987966 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41100b15-1dd4-4671-b6a9-f56749cccadb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:46.000332 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41100b15-1dd4-4671-b6a9-f56749cccadb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:46.001962 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41100b15-1dd4-4671-b6a9-f56749cccadb None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:46.021478 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-41100b15-1dd4-4671-b6a9-f56749cccadb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:46.021478 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:46.021478 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:46.021478 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:46.021478 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:46.021478 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:46.021478 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:46.021478 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:46.021478 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:46.021478 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:46.021478 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:46.021478 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:46.021478 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:53:46.021478 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:53:46.021478 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:53:46.021478 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:53:46.022771 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:46.022771 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:46.022771 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:46.022771 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:46.022771 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:46.022771 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:46.022771 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:46.022771 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:46.022771 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:46.022771 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:46.022771 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:46.022771 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:46.022771 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:46.022771 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:46.022771 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:46.022771 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:46.022771 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:53:46.024073 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:53:46.024073 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:46.024073 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:53:46.024073 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 310/626] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:53:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:46.024073 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41100b15-1dd4-4671-b6a9-f56749cccadb None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:46.083975 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcadc7b6-42a1-41d6-8f4f-5534fa4b1803 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:46.122286 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ccb28-32ca-4501-825d-41800b00c32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:46.123235 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ccb28-32ca-4501-825d-41800b00c32d None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:46.123687 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ccb28-32ca-4501-825d-41800b00c32d None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:46.124129 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ccb28-32ca-4501-825d-41800b00c32d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:46.138207 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:46.153701 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41100b15-1dd4-4671-b6a9-f56749cccadb None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:46.170392 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:46.192856 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b9812f-f496-45d4-92a5-082417fe1463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:46.193483 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9812f-f496-45d4-92a5-082417fe1463 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:46.193764 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9812f-f496-45d4-92a5-082417fe1463 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:46.194034 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9812f-f496-45d4-92a5-082417fe1463 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:46.197277 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9ccb28-32ca-4501-825d-41800b00c32d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:46.198900 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9ccb28-32ca-4501-825d-41800b00c32d None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:46.201253 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b9812f-f496-45d4-92a5-082417fe1463 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:46.202788 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b9812f-f496-45d4-92a5-082417fe1463 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:46.214677 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-e4b9812f-f496-45d4-92a5-082417fe1463 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:53:46.214677 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:46.214677 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:46.214677 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:46.214677 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:46.214677 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:46.214677 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:46.214677 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:46.214677 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:46.214677 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:46.214677 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:46.214677 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:46.214677 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 15:53:46.214677 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 15:53:46.214677 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 15:53:46.215770 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 15:53:46.215770 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:46.215770 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:46.215770 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:46.215770 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:46.215770 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:46.215770 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:46.215770 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:46.215770 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:46.215770 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:46.215770 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:46.215770 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:46.215770 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:46.215770 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:46.215770 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:46.215770 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:46.215770 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:46.216721 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 15:53:46.216721 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 15:53:46.216721 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 15:53:46.216721 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 15:53:46.216721 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 15:53:46.216721 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 15:53:46.216721 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:53:46.216721 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:53:46.216721 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 311/627] 10.222.0.70 () {56 vars in 1111 bytes} [Fri Aug 19 15:53:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:46.217238 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b9812f-f496-45d4-92a5-082417fe1463 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:46.303361 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 317/628] 10.222.0.70 () {58 vars in 1282 bytes} [Fri Aug 19 15:53:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:53:46.304537 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3c4e5-1545-4025-8d80-5fa179bad0c0 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:46.304848 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3c4e5-1545-4025-8d80-5fa179bad0c0 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:46.305118 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3c4e5-1545-4025-8d80-5fa179bad0c0 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:46.306351 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 318/629] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:53:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:53:46.307088 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3c4e5-1545-4025-8d80-5fa179bad0c0 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:46.325416 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b9812f-f496-45d4-92a5-082417fe1463 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:46.371034 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee97121-4c1f-46cd-a521-8ded2440a63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:46.371738 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee97121-4c1f-46cd-a521-8ded2440a63f None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:46.372029 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee97121-4c1f-46cd-a521-8ded2440a63f None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:46.372284 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee97121-4c1f-46cd-a521-8ded2440a63f None admin] PATH_INFO: `/v3/domains` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:46.372997 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee97121-4c1f-46cd-a521-8ded2440a63f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:46.373307 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee97121-4c1f-46cd-a521-8ded2440a63f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:46.374673 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee97121-4c1f-46cd-a521-8ded2440a63f None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:46.387648 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 312/630] 10.222.0.70 () {56 vars in 1109 bytes} [Fri Aug 19 15:53:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:46.388319 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee97121-4c1f-46cd-a521-8ded2440a63f None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:46.397147 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:46.397361 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:46.431559 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3c4e5-1545-4025-8d80-5fa179bad0c0 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:46.468418 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b681ff-8c5b-4c5a-aac1-01dd26530c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:46.469266 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b681ff-8c5b-4c5a-aac1-01dd26530c56 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:46.469655 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b681ff-8c5b-4c5a-aac1-01dd26530c56 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:46.470023 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b681ff-8c5b-4c5a-aac1-01dd26530c56 None admin] PATH_INFO: `/v3/projects` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:46.470951 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b681ff-8c5b-4c5a-aac1-01dd26530c56 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:46.471256 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b681ff-8c5b-4c5a-aac1-01dd26530c56 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:46.473441 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b681ff-8c5b-4c5a-aac1-01dd26530c56 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:46.486046 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 319/631] 10.222.0.70 () {56 vars in 1148 bytes} [Fri Aug 19 15:53:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:46.487294 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f61f2-af19-4609-9f1c-72449c373f71 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:46.487598 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f61f2-af19-4609-9f1c-72449c373f71 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:46.487862 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f61f2-af19-4609-9f1c-72449c373f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:46.500411 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee97121-4c1f-46cd-a521-8ded2440a63f None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:46.506740 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-a41f61f2-af19-4609-9f1c-72449c373f71 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:53:46.507943 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-a41f61f2-af19-4609-9f1c-72449c373f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:53:46.536109 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488f69f-85ed-47ff-a2c3-438954cd3a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:46.536791 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488f69f-85ed-47ff-a2c3-438954cd3a3a None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:46.537070 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488f69f-85ed-47ff-a2c3-438954cd3a3a None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:46.537359 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488f69f-85ed-47ff-a2c3-438954cd3a3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:46.548812 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1488f69f-85ed-47ff-a2c3-438954cd3a3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:46.550693 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1488f69f-85ed-47ff-a2c3-438954cd3a3a None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:46.566049 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-1488f69f-85ed-47ff-a2c3-438954cd3a3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:46.566049 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:46.566049 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:46.566049 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:46.566049 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:46.566049 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:46.566049 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:46.566049 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:46.566049 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:46.566049 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:46.566049 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:46.566049 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:46.566049 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:53:46.566049 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:53:46.566049 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:53:46.566049 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:53:46.567196 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:46.567196 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:46.567196 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:46.567196 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:46.567196 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:46.567196 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:46.567196 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:46.567196 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:46.567196 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:46.567196 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:46.567196 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:46.567196 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:46.567196 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:46.567196 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:46.567196 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:46.567196 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:46.567196 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:53:46.568345 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:53:46.568345 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:46.568345 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:53:46.568345 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 313/632] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:53:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:46.568345 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488f69f-85ed-47ff-a2c3-438954cd3a3a None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:46.581097 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 320/633] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:53:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:53:46.582222 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f61f2-af19-4609-9f1c-72449c373f71 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:46.636309 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:46.667071 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:46.684270 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488f69f-85ed-47ff-a2c3-438954cd3a3a None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:46.709458 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f61f2-af19-4609-9f1c-72449c373f71 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:46.722721 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7d192-9c55-4d92-ab0a-d5c802b01b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:46.723356 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7d192-9c55-4d92-ab0a-d5c802b01b29 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:46.723633 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7d192-9c55-4d92-ab0a-d5c802b01b29 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:46.723905 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7d192-9c55-4d92-ab0a-d5c802b01b29 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:46.733240 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7d192-9c55-4d92-ab0a-d5c802b01b29 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:46.734683 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7d192-9c55-4d92-ab0a-d5c802b01b29 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:46.747196 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-c1c7d192-9c55-4d92-ab0a-d5c802b01b29 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:53:46.747196 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:46.747196 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:46.747196 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:46.747196 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:46.747196 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:46.747196 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:46.747196 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:46.747196 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:46.747196 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:46.747196 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:46.747196 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:46.747196 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 15:53:46.747196 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 15:53:46.747196 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 15:53:46.748163 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 15:53:46.748163 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:46.748163 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:46.748163 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:46.748163 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:46.748163 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:46.748163 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:46.748163 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:46.748163 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:46.748163 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:46.748163 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:46.748163 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:46.748163 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:46.748163 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:46.748163 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:46.748163 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:46.748163 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:46.749089 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 15:53:46.749089 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 15:53:46.749089 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 15:53:46.749089 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 15:53:46.749089 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 15:53:46.749089 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 15:53:46.749089 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:53:46.749089 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:53:46.753132 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 314/634] 10.222.0.70 () {56 vars in 1111 bytes} [Fri Aug 19 15:53:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:46.754157 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7d192-9c55-4d92-ab0a-d5c802b01b29 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:46.766906 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76340ab4-8051-4b46-934a-183598a7b3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:46.767561 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76340ab4-8051-4b46-934a-183598a7b3a5 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:46.767836 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76340ab4-8051-4b46-934a-183598a7b3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:46.768100 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76340ab4-8051-4b46-934a-183598a7b3a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:46.768865 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76340ab4-8051-4b46-934a-183598a7b3a5 None admin] RBAC: Adding query filter params (role.id=f082292a9c404c30891116a86c08becd, scope.project.id=48fb7e21c6864d30b70ffca9093afec8, user.id=3d70aff7f0a448bb9a5cc2b78c828590) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:46.769168 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76340ab4-8051-4b46-934a-183598a7b3a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:46.770587 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76340ab4-8051-4b46-934a-183598a7b3a5 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:46.788705 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 321/635] 10.222.0.70 () {56 vars in 1374 bytes} [Fri Aug 19 15:53:46 2022] GET /identity/v3/role_assignments?user.id=3d70aff7f0a448bb9a5cc2b78c828590&scope.project.id=48fb7e21c6864d30b70ffca9093afec8&role.id=f082292a9c404c30891116a86c08becd => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:46.788705 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76340ab4-8051-4b46-934a-183598a7b3a5 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:46.914227 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76340ab4-8051-4b46-934a-183598a7b3a5 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:46.929443 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7d192-9c55-4d92-ab0a-d5c802b01b29 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:46.951112 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:46.952873 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:46.960858 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d38d73e-fe14-40e5-a117-adb3ed457200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:46.961477 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38d73e-fe14-40e5-a117-adb3ed457200 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:46.961749 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38d73e-fe14-40e5-a117-adb3ed457200 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:46.962019 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38d73e-fe14-40e5-a117-adb3ed457200 None admin] PATH_INFO: `/v3/projects` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:46.966522 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d38d73e-fe14-40e5-a117-adb3ed457200 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:46.966522 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d38d73e-fe14-40e5-a117-adb3ed457200 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:46.966522 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d38d73e-fe14-40e5-a117-adb3ed457200 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:46.974017 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d597af1f-912b-4dea-b2c5-8595e92e6e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:46.975268 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597af1f-912b-4dea-b2c5-8595e92e6e8d None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:46.975268 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597af1f-912b-4dea-b2c5-8595e92e6e8d None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:46.975268 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597af1f-912b-4dea-b2c5-8595e92e6e8d None admin] PATH_INFO: `/v3/domains` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:46.975914 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d597af1f-912b-4dea-b2c5-8595e92e6e8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:46.976221 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d597af1f-912b-4dea-b2c5-8595e92e6e8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:46.977641 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d597af1f-912b-4dea-b2c5-8595e92e6e8d None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:46.979012 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 322/636] 10.222.0.70 () {56 vars in 1148 bytes} [Fri Aug 19 15:53:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:46.979809 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d38d73e-fe14-40e5-a117-adb3ed457200 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:46.993185 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 315/637] 10.222.0.70 () {56 vars in 1109 bytes} [Fri Aug 19 15:53:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:46.999104 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d597af1f-912b-4dea-b2c5-8595e92e6e8d None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:47.107021 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d38d73e-fe14-40e5-a117-adb3ed457200 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:47.124589 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d597af1f-912b-4dea-b2c5-8595e92e6e8d None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:47.146749 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c833a445-dd83-446b-81d4-c071986ae290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:47.147509 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833a445-dd83-446b-81d4-c071986ae290 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:47.152071 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833a445-dd83-446b-81d4-c071986ae290 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:47.152071 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833a445-dd83-446b-81d4-c071986ae290 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:47.161355 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ce89af-ac2a-45e7-9bf5-1f7aeb01f629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:47.161964 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce89af-ac2a-45e7-9bf5-1f7aeb01f629 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:47.162242 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce89af-ac2a-45e7-9bf5-1f7aeb01f629 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:47.162788 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce89af-ac2a-45e7-9bf5-1f7aeb01f629 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:47.167332 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c833a445-dd83-446b-81d4-c071986ae290 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:53:47.167454 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ce89af-ac2a-45e7-9bf5-1f7aeb01f629 None admin] RBAC: Adding query filter params (role.id=f082292a9c404c30891116a86c08becd, scope.project.id=48fb7e21c6864d30b70ffca9093afec8, user.id=92eb2988fd86400dacb28eeef921a4b8) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:47.167454 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ce89af-ac2a-45e7-9bf5-1f7aeb01f629 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:47.167454 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ce89af-ac2a-45e7-9bf5-1f7aeb01f629 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:47.169156 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-c833a445-dd83-446b-81d4-c071986ae290 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:53:47.169156 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:47.169156 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:47.169156 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:47.169156 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:47.169156 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:47.169156 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:47.169156 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:47.169156 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:47.169156 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:47.169156 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:47.169156 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:47.169156 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:53:47.169156 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:53:47.169156 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:53:47.169156 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:53:47.170291 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:53:47.170291 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:53:47.170291 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:53:47.170291 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:53:47.170291 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:47.170291 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:47.170291 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:47.170291 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:47.170291 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:47.170291 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:47.170291 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:47.170291 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:47.170291 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:47.170291 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:47.170291 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:47.170291 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:47.176017 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:47.176017 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:47.176017 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:47.176017 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:47.176017 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:53:47.176017 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:53:47.176017 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:53:47.176017 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:53:47.176017 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:53:47.176017 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:53:47.176017 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:53:47.176017 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:47.176017 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 323/638] 10.222.0.70 () {56 vars in 1096 bytes} [Fri Aug 19 15:53:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:47.176017 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c833a445-dd83-446b-81d4-c071986ae290 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:47.181212 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 316/639] 10.222.0.70 () {56 vars in 1374 bytes} [Fri Aug 19 15:53:46 2022] GET /identity/v3/role_assignments?user.id=92eb2988fd86400dacb28eeef921a4b8&scope.project.id=48fb7e21c6864d30b70ffca9093afec8&role.id=f082292a9c404c30891116a86c08becd => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:47.183199 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ce89af-ac2a-45e7-9bf5-1f7aeb01f629 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:47.237674 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:47.241923 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:47.306499 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c833a445-dd83-446b-81d4-c071986ae290 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:47.316213 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ce89af-ac2a-45e7-9bf5-1f7aeb01f629 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:47.348924 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed9886-0996-4f7f-a729-6653179ca129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:47.349833 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed9886-0996-4f7f-a729-6653179ca129 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:47.350296 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed9886-0996-4f7f-a729-6653179ca129 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:47.350713 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed9886-0996-4f7f-a729-6653179ca129 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:47.358505 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7725b0dc-e9b6-4ba0-8196-7a9c55949d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:47.359269 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725b0dc-e9b6-4ba0-8196-7a9c55949d37 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:47.359663 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725b0dc-e9b6-4ba0-8196-7a9c55949d37 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:47.360028 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725b0dc-e9b6-4ba0-8196-7a9c55949d37 None admin] PATH_INFO: `/v3/roles` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:47.360363 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed9886-0996-4f7f-a729-6653179ca129 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:47.360976 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7725b0dc-e9b6-4ba0-8196-7a9c55949d37 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:47.361382 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7725b0dc-e9b6-4ba0-8196-7a9c55949d37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:47.362510 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed9886-0996-4f7f-a729-6653179ca129 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:47.362952 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7725b0dc-e9b6-4ba0-8196-7a9c55949d37 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:47.375085 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 317/640] 10.222.0.70 () {56 vars in 1099 bytes} [Fri Aug 19 15:53:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:47.378515 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-43ed9886-0996-4f7f-a729-6653179ca129 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:53:47.378515 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:47.378515 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:47.378515 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:47.378515 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:47.378515 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:47.378515 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:47.378515 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:47.378515 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:47.378515 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:47.378515 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:47.378515 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:47.378515 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 15:53:47.378515 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 15:53:47.378515 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 15:53:47.379507 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 15:53:47.379507 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:47.379507 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:47.379507 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:47.379507 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:47.379507 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:47.379507 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:47.379507 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:47.379507 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:47.379507 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:47.379507 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:47.379507 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:47.379507 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:47.379507 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:47.379507 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:47.379507 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:47.379507 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:47.380948 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 15:53:47.380948 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 15:53:47.380948 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 15:53:47.380948 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 15:53:47.380948 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 15:53:47.380948 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 15:53:47.380948 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:53:47.380948 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:47.380948 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 324/641] 10.222.0.70 () {56 vars in 1111 bytes} [Fri Aug 19 15:53:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:47.381749 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7725b0dc-e9b6-4ba0-8196-7a9c55949d37 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:47.385669 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed9886-0996-4f7f-a729-6653179ca129 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:47.510674 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed9886-0996-4f7f-a729-6653179ca129 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:47.511947 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7725b0dc-e9b6-4ba0-8196-7a9c55949d37 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:47.515420 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:47.519405 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:47.559928 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677cf42-5c6a-4a26-94f5-e28124a72723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:47.560954 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677cf42-5c6a-4a26-94f5-e28124a72723 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:47.561320 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11421416-13aa-44ee-a72f-24a050c88452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:47.561615 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677cf42-5c6a-4a26-94f5-e28124a72723 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:47.562024 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677cf42-5c6a-4a26-94f5-e28124a72723 None admin] PATH_INFO: `/v3/projects` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:47.562271 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11421416-13aa-44ee-a72f-24a050c88452 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:47.562649 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11421416-13aa-44ee-a72f-24a050c88452 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:47.563030 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11421416-13aa-44ee-a72f-24a050c88452 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:47.563348 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9677cf42-5c6a-4a26-94f5-e28124a72723 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:47.563790 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9677cf42-5c6a-4a26-94f5-e28124a72723 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:47.565601 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9677cf42-5c6a-4a26-94f5-e28124a72723 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:47.577671 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11421416-13aa-44ee-a72f-24a050c88452 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:47.579161 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 325/642] 10.222.0.70 () {56 vars in 1148 bytes} [Fri Aug 19 15:53:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:53:47.579271 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11421416-13aa-44ee-a72f-24a050c88452 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:47.588811 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677cf42-5c6a-4a26-94f5-e28124a72723 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:47.596302 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-11421416-13aa-44ee-a72f-24a050c88452 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:47.596302 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:47.596302 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:47.596302 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:47.596302 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:47.596302 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:47.596302 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:47.596302 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:47.596302 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:47.596302 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:47.596302 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:47.596302 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:47.596302 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:53:47.596302 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:53:47.596302 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:53:47.596302 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:53:47.597285 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:47.597285 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:47.597285 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:47.597285 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:47.597285 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:47.597285 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:47.597285 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:47.597285 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:47.597285 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:47.597285 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:47.597285 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:47.597285 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:47.597285 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:47.597285 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:47.597285 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:47.597285 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:47.597285 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:53:47.598157 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:53:47.598157 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:47.598157 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:53:47.598157 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 318/643] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:53:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:47.604931 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11421416-13aa-44ee-a72f-24a050c88452 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:47.727547 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677cf42-5c6a-4a26-94f5-e28124a72723 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:47.733899 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11421416-13aa-44ee-a72f-24a050c88452 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:47.771476 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c6818-89ae-4982-a6f9-c5e4118f8829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:47.772151 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c6818-89ae-4982-a6f9-c5e4118f8829 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:47.772530 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c6818-89ae-4982-a6f9-c5e4118f8829 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:47.772915 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c6818-89ae-4982-a6f9-c5e4118f8829 None admin] PATH_INFO: `/v3/domains` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:47.773710 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023c6818-89ae-4982-a6f9-c5e4118f8829 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:47.774113 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023c6818-89ae-4982-a6f9-c5e4118f8829 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:47.775841 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321c6d1-0bbd-41b0-8c9c-d69b3697c8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:47.776308 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023c6818-89ae-4982-a6f9-c5e4118f8829 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:47.777091 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321c6d1-0bbd-41b0-8c9c-d69b3697c8d8 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:47.777538 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321c6d1-0bbd-41b0-8c9c-d69b3697c8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:47.777949 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321c6d1-0bbd-41b0-8c9c-d69b3697c8d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:47.779047 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1321c6d1-0bbd-41b0-8c9c-d69b3697c8d8 None admin] RBAC: Adding query filter params (role.id=f082292a9c404c30891116a86c08becd, scope.project.id=48fb7e21c6864d30b70ffca9093afec8, user.id=f5593ee9d30b4b65a215a4fe8dfba060) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:47.779500 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1321c6d1-0bbd-41b0-8c9c-d69b3697c8d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:47.781622 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1321c6d1-0bbd-41b0-8c9c-d69b3697c8d8 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:47.796726 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 326/644] 10.222.0.70 () {56 vars in 1374 bytes} [Fri Aug 19 15:53:47 2022] GET /identity/v3/role_assignments?user.id=f5593ee9d30b4b65a215a4fe8dfba060&scope.project.id=48fb7e21c6864d30b70ffca9093afec8&role.id=f082292a9c404c30891116a86c08becd => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:47.800706 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 319/645] 10.222.0.70 () {56 vars in 1109 bytes} [Fri Aug 19 15:53:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:53:47.805925 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321c6d1-0bbd-41b0-8c9c-d69b3697c8d8 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:47.843664 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:47.932922 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321c6d1-0bbd-41b0-8c9c-d69b3697c8d8 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:47.974231 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0bc974-ac3c-4a90-9ddf-b335dcada88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:47.974893 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0bc974-ac3c-4a90-9ddf-b335dcada88f None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:47.975174 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0bc974-ac3c-4a90-9ddf-b335dcada88f None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:47.975447 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0bc974-ac3c-4a90-9ddf-b335dcada88f None admin] PATH_INFO: `/v3/users/nova` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:47.985787 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0bc974-ac3c-4a90-9ddf-b335dcada88f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:47.987331 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0bc974-ac3c-4a90-9ddf-b335dcada88f None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:48.000478 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-0d0bc974-ac3c-4a90-9ddf-b335dcada88f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 15:53:48.000478 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:48.000478 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:48.000478 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:48.000478 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:48.000478 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:48.000478 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:48.000478 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:48.000478 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:48.000478 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:48.000478 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:48.000478 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:48.000478 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 15:53:48.000478 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 15:53:48.000478 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 15:53:48.000478 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 15:53:48.001516 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:48.001516 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:48.001516 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 15:53:48.001516 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:53:48.001516 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 15:53:48.001516 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:53:48.001516 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:48.001516 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:48.001516 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:48.001516 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:48.001516 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:48.001516 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:48.001516 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:48.001516 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:48.001516 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:48.001516 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:48.001516 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:48.001516 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:48.002472 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:48.002472 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:48.002472 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 15:53:48.002472 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 15:53:48.002472 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 15:53:48.002472 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 15:53:48.002472 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 15:53:48.002472 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 15:53:48.002472 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 15:53:48.002472 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:48.002472 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 327/646] 10.222.0.70 () {56 vars in 1093 bytes} [Fri Aug 19 15:53:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:48.008186 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c6818-89ae-4982-a6f9-c5e4118f8829 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:48.032490 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:48.135362 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c6818-89ae-4982-a6f9-c5e4118f8829 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:48.176771 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679923c5-8e85-4431-baa5-3e38a86eb1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:48.177753 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679923c5-8e85-4431-baa5-3e38a86eb1db None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:48.178238 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679923c5-8e85-4431-baa5-3e38a86eb1db None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:48.178709 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679923c5-8e85-4431-baa5-3e38a86eb1db None admin] PATH_INFO: `/v3/users` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:48.179612 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679923c5-8e85-4431-baa5-3e38a86eb1db None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:48.179933 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679923c5-8e85-4431-baa5-3e38a86eb1db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:48.181380 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679923c5-8e85-4431-baa5-3e38a86eb1db None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:48.203295 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 320/647] 10.222.0.70 () {56 vars in 1133 bytes} [Fri Aug 19 15:53:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:48.209083 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0bc974-ac3c-4a90-9ddf-b335dcada88f None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:48.316210 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:48.327904 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0bc974-ac3c-4a90-9ddf-b335dcada88f None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:48.366118 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86f8c9-32d9-4164-839b-cd2b1c707618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:48.367075 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86f8c9-32d9-4164-839b-cd2b1c707618 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:48.367572 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86f8c9-32d9-4164-839b-cd2b1c707618 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:48.368068 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86f8c9-32d9-4164-839b-cd2b1c707618 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:48.445472 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed86f8c9-32d9-4164-839b-cd2b1c707618 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:48.448022 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed86f8c9-32d9-4164-839b-cd2b1c707618 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:48.562507 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:48.575875 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 328/648] 10.222.0.70 () {58 vars in 1282 bytes} [Fri Aug 19 15:53:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:53:48.582038 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679923c5-8e85-4431-baa5-3e38a86eb1db None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:48.687826 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:48.721354 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679923c5-8e85-4431-baa5-3e38a86eb1db None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:48.763099 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e674745-fd16-413c-85f0-e1737b4d2928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:48.764555 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e674745-fd16-413c-85f0-e1737b4d2928 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:48.765074 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e674745-fd16-413c-85f0-e1737b4d2928 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:48.765539 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e674745-fd16-413c-85f0-e1737b4d2928 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:48.777538 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e674745-fd16-413c-85f0-e1737b4d2928 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:48.779306 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e674745-fd16-413c-85f0-e1737b4d2928 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:48.796062 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-4e674745-fd16-413c-85f0-e1737b4d2928 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:48.796062 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:48.796062 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:48.796062 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:48.796062 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:48.796062 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:48.796062 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:48.796062 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:48.796062 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:48.796062 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:48.796062 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:48.796062 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:48.796062 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:53:48.796062 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:53:48.796062 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:53:48.796062 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:53:48.797124 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:48.797124 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:48.797124 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:48.797124 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:48.797124 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:48.797124 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:48.797124 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:48.797124 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:48.797124 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:48.797124 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:48.797124 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:48.797124 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:48.797124 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:48.797124 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:48.797124 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:48.797124 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:48.797124 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:53:48.798001 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:53:48.798001 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:48.798001 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:53:48.800091 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 321/649] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:53:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:53:48.806932 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86f8c9-32d9-4164-839b-cd2b1c707618 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:48.921595 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86f8c9-32d9-4164-839b-cd2b1c707618 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:48.958878 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3c297-112b-4439-8964-8e6a4c0f164f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:48.959488 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3c297-112b-4439-8964-8e6a4c0f164f None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:48.959763 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3c297-112b-4439-8964-8e6a4c0f164f None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:48.960034 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3c297-112b-4439-8964-8e6a4c0f164f None admin] PATH_INFO: `/v3/domains` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:48.960689 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd3c297-112b-4439-8964-8e6a4c0f164f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:48.961009 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd3c297-112b-4439-8964-8e6a4c0f164f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:48.962453 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd3c297-112b-4439-8964-8e6a4c0f164f None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:48.975771 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 329/650] 10.222.0.70 () {56 vars in 1109 bytes} [Fri Aug 19 15:53:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:48.982241 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e674745-fd16-413c-85f0-e1737b4d2928 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:49.117165 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e674745-fd16-413c-85f0-e1737b4d2928 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:49.148440 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:49.158079 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ecb47-663f-431e-8f98-28d1721a250f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:49.158714 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ecb47-663f-431e-8f98-28d1721a250f None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:49.159076 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ecb47-663f-431e-8f98-28d1721a250f None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:49.159243 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ecb47-663f-431e-8f98-28d1721a250f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:49.167935 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ecb47-663f-431e-8f98-28d1721a250f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:49.169610 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ecb47-663f-431e-8f98-28d1721a250f None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:49.185393 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-d69ecb47-663f-431e-8f98-28d1721a250f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:53:49.185393 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:49.185393 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:49.185393 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:49.185393 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:49.185393 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:49.185393 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:49.185393 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:49.185393 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:49.185393 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:49.185393 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:49.185393 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:49.185393 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 15:53:49.185393 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 15:53:49.185393 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 15:53:49.186311 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 15:53:49.186311 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:49.186311 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:49.186311 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:49.186311 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:49.186311 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:49.186311 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:49.186311 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:49.186311 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:49.186311 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:49.186311 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:49.186311 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:49.186311 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:49.186311 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:49.186311 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:49.186311 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:49.186311 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:49.187189 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 15:53:49.187189 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 15:53:49.187189 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 15:53:49.187189 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 15:53:49.187189 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 15:53:49.187189 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 15:53:49.187189 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:53:49.187189 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:53:49.187627 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62ebd1-32fa-463a-87e3-090734472ecd None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:49.187627 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62ebd1-32fa-463a-87e3-090734472ecd None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:49.187627 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62ebd1-32fa-463a-87e3-090734472ecd None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:49.187819 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 322/651] 10.222.0.70 () {56 vars in 1111 bytes} [Fri Aug 19 15:53:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:49.187894 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 330/652] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:53:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 15:53:49.192848 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62ebd1-32fa-463a-87e3-090734472ecd None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:49.193074 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac13d8-71ef-4741-a77a-812d0d60b8e1 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:49.193301 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac13d8-71ef-4741-a77a-812d0d60b8e1 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:49.193581 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac13d8-71ef-4741-a77a-812d0d60b8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:49.217783 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-a9ac13d8-71ef-4741-a77a-812d0d60b8e1 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:53:49.219087 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-a9ac13d8-71ef-4741-a77a-812d0d60b8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:53:49.260414 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:49.307038 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 323/653] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:53:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 15:53:49.321837 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62ebd1-32fa-463a-87e3-090734472ecd None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:49.366635 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd6fd2-5dce-4d79-aa5d-1b3c4b474903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:49.367283 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd6fd2-5dce-4d79-aa5d-1b3c4b474903 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:49.367533 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd6fd2-5dce-4d79-aa5d-1b3c4b474903 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:49.367902 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd6fd2-5dce-4d79-aa5d-1b3c4b474903 None admin] PATH_INFO: `/v3/projects` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:49.368601 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfd6fd2-5dce-4d79-aa5d-1b3c4b474903 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:49.368990 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfd6fd2-5dce-4d79-aa5d-1b3c4b474903 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:49.370464 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfd6fd2-5dce-4d79-aa5d-1b3c4b474903 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:49.384655 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 331/654] 10.222.0.70 () {56 vars in 1148 bytes} [Fri Aug 19 15:53:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:49.390604 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ac13d8-71ef-4741-a77a-812d0d60b8e1 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:49.503930 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ac13d8-71ef-4741-a77a-812d0d60b8e1 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:49.522541 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:49.542472 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e84d80c-2d43-4487-813b-ebec634055e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:49.543391 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84d80c-2d43-4487-813b-ebec634055e9 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:49.560783 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84d80c-2d43-4487-813b-ebec634055e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:49.560783 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84d80c-2d43-4487-813b-ebec634055e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:49.560783 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e84d80c-2d43-4487-813b-ebec634055e9 None admin] RBAC: Adding query filter params (role.id=2f6cb7d6ec874879972a12a63d61068d, scope.project.id=48fb7e21c6864d30b70ffca9093afec8, user.id=d90cec9e3ff64b5aa4cc867895b996ad) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:49.560783 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e84d80c-2d43-4487-813b-ebec634055e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:49.560783 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e84d80c-2d43-4487-813b-ebec634055e9 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:49.561226 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 324/655] 10.222.0.70 () {56 vars in 1374 bytes} [Fri Aug 19 15:53:49 2022] GET /identity/v3/role_assignments?user.id=d90cec9e3ff64b5aa4cc867895b996ad&scope.project.id=48fb7e21c6864d30b70ffca9093afec8&role.id=2f6cb7d6ec874879972a12a63d61068d => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:49.623716 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910d7f6-5f67-41e3-8486-c12e17649006 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:49.624074 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910d7f6-5f67-41e3-8486-c12e17649006 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:49.624253 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910d7f6-5f67-41e3-8486-c12e17649006 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:49.625976 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 332/656] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:53:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:53:49.631893 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a6fbe-b537-4299-add7-782c8846d116 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:49.632194 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a6fbe-b537-4299-add7-782c8846d116 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:49.632448 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a6fbe-b537-4299-add7-782c8846d116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:49.653516 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-637a6fbe-b537-4299-add7-782c8846d116 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:53:49.654852 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-637a6fbe-b537-4299-add7-782c8846d116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:53:49.663929 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910d7f6-5f67-41e3-8486-c12e17649006 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:49.734428 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 325/657] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:53:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:53:49.785749 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910d7f6-5f67-41e3-8486-c12e17649006 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:49.798837 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:49.823377 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c945c-d8f2-47eb-b02e-e7664d223bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:49.824143 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c945c-d8f2-47eb-b02e-e7664d223bc1 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:49.824505 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c945c-d8f2-47eb-b02e-e7664d223bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:49.824814 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c945c-d8f2-47eb-b02e-e7664d223bc1 None admin] PATH_INFO: `/v3/services/image` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:49.832368 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574c945c-d8f2-47eb-b02e-e7664d223bc1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:49.832368 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574c945c-d8f2-47eb-b02e-e7664d223bc1 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:49.838830 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-574c945c-d8f2-47eb-b02e-e7664d223bc1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 15:53:49.838830 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:49.838830 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 15:53:49.838830 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 15:53:49.838830 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 15:53:49.838830 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 15:53:49.838830 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 15:53:49.838830 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:53:49.838830 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 15:53:49.838830 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:49.838830 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 15:53:49.838830 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:49.838830 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:49.838830 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:49.838830 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:49.838830 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:49.838830 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:49.839999 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:49.839999 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:49.839999 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:49.839999 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:49.839999 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:49.839999 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:49.839999 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 15:53:49.839999 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 15:53:49.839999 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 15:53:49.839999 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 15:53:49.839999 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:49.839999 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:49.839999 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:49.839999 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:49.839999 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:49.839999 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:49.840861 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:49.840861 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:49.840861 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:49.840861 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:49.840861 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:49.840861 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:49.840861 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:49.840861 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:49.840861 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:49.840861 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:49.840861 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 15:53:49.840861 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:53:49.840861 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 15:53:49.840861 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:49.840861 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 333/658] 10.222.0.70 () {56 vars in 1105 bytes} [Fri Aug 19 15:53:49 2022] GET /identity/v3/services/image => generated 86 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:49.849858 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a6fbe-b537-4299-add7-782c8846d116 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:49.957606 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a6fbe-b537-4299-add7-782c8846d116 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:49.969808 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:49.994786 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a176e24-144e-41e6-9690-e22b13fbe23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:49.995405 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a176e24-144e-41e6-9690-e22b13fbe23e None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:49.995686 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a176e24-144e-41e6-9690-e22b13fbe23e None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:49.995959 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a176e24-144e-41e6-9690-e22b13fbe23e None admin] PATH_INFO: `/v3/services` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:49.996589 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a176e24-144e-41e6-9690-e22b13fbe23e None admin] RBAC: Adding query filter params (name=image) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:49.996911 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a176e24-144e-41e6-9690-e22b13fbe23e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:49.998277 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a176e24-144e-41e6-9690-e22b13fbe23e None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:50.003562 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 326/659] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:53:49 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:50.009148 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c945c-d8f2-47eb-b02e-e7664d223bc1 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:50.085585 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a176e24-144e-41e6-9690-e22b13fbe23e None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:50.123359 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c945c-d8f2-47eb-b02e-e7664d223bc1 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:50.170856 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca092525-9221-45d5-9d25-f946bc47c251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:50.171465 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca092525-9221-45d5-9d25-f946bc47c251 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:50.171740 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca092525-9221-45d5-9d25-f946bc47c251 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:50.172010 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca092525-9221-45d5-9d25-f946bc47c251 None admin] PATH_INFO: `/v3/services` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:50.172642 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca092525-9221-45d5-9d25-f946bc47c251 None admin] RBAC: Adding query filter params (type=image) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:50.172995 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca092525-9221-45d5-9d25-f946bc47c251 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:50.174993 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca092525-9221-45d5-9d25-f946bc47c251 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:50.183956 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 334/660] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:53:50 2022] GET /identity/v3/services?type=image => generated 122 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:50.208191 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a176e24-144e-41e6-9690-e22b13fbe23e None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:50.251455 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9faee4-96e4-4a85-8951-4db35baf53b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:50.252399 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9faee4-96e4-4a85-8951-4db35baf53b2 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:50.253149 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9faee4-96e4-4a85-8951-4db35baf53b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:50.253565 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9faee4-96e4-4a85-8951-4db35baf53b2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:50.254319 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9faee4-96e4-4a85-8951-4db35baf53b2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:50.255896 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9faee4-96e4-4a85-8951-4db35baf53b2 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:50.269781 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-ff9faee4-96e4-4a85-8951-4db35baf53b2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 15:53:50.269781 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:50.269781 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 15:53:50.269781 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 15:53:50.269781 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 15:53:50.269781 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 15:53:50.269781 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 15:53:50.269781 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:53:50.269781 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 15:53:50.269781 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:53:50.269781 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 15:53:50.269781 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:53:50.269781 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:50.269781 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:50.269781 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:50.269781 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:50.269781 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:50.271071 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:50.271071 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:50.271071 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:50.271071 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:50.271071 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:50.271071 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:50.271071 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 15:53:50.271071 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 15:53:50.271071 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 15:53:50.271071 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 15:53:50.271071 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:50.271071 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:50.271071 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:50.271071 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:50.271071 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:50.271071 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:50.272108 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:50.272108 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:50.272108 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:50.272108 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:50.272108 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:50.272108 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:50.272108 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:50.272108 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:50.272108 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:50.272108 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:50.272108 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 15:53:50.272108 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:53:50.272108 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 15:53:50.272108 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:53:50.274805 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 327/661] 10.222.0.70 () {56 vars in 1129 bytes} [Fri Aug 19 15:53:50 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:53:50.281679 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca092525-9221-45d5-9d25-f946bc47c251 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:50.336361 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:50.417084 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca092525-9221-45d5-9d25-f946bc47c251 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:50.434411 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c089c62-cc34-4fc7-b1b4-66fa6ac56edd None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:50.434698 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c089c62-cc34-4fc7-b1b4-66fa6ac56edd None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:50.434978 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c089c62-cc34-4fc7-b1b4-66fa6ac56edd None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:50.436615 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 328/662] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:53:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 15:53:50.441980 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f772ea-a955-4ac3-b464-9836581c8d40 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:50.442263 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f772ea-a955-4ac3-b464-9836581c8d40 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:50.442540 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f772ea-a955-4ac3-b464-9836581c8d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:50.458047 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b3cc3b-1bd0-4f1b-94ad-7c1cdde89283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:50.459035 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3cc3b-1bd0-4f1b-94ad-7c1cdde89283 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:50.459487 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3cc3b-1bd0-4f1b-94ad-7c1cdde89283 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:50.459944 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3cc3b-1bd0-4f1b-94ad-7c1cdde89283 None admin] PATH_INFO: `/v3/services` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:50.460773 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b3cc3b-1bd0-4f1b-94ad-7c1cdde89283 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:50.461248 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b3cc3b-1bd0-4f1b-94ad-7c1cdde89283 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:50.463383 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-89f772ea-a955-4ac3-b464-9836581c8d40 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:53:50.463831 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b3cc3b-1bd0-4f1b-94ad-7c1cdde89283 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:50.464885 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-89f772ea-a955-4ac3-b464-9836581c8d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:53:50.469792 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 335/663] 10.222.0.70 () {56 vars in 1124 bytes} [Fri Aug 19 15:53:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:50.478818 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b3cc3b-1bd0-4f1b-94ad-7c1cdde89283 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:50.505754 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:50.567265 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 329/664] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:53:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 15:53:50.610945 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b3cc3b-1bd0-4f1b-94ad-7c1cdde89283 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:50.612428 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:50.649627 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6468cef-929c-42c6-a760-9fcf4ba64f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:50.650543 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6468cef-929c-42c6-a760-9fcf4ba64f95 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:50.650830 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6468cef-929c-42c6-a760-9fcf4ba64f95 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:50.651102 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6468cef-929c-42c6-a760-9fcf4ba64f95 None admin] PATH_INFO: `/v3/services` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:50.652320 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6468cef-929c-42c6-a760-9fcf4ba64f95 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:50.652622 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6468cef-929c-42c6-a760-9fcf4ba64f95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:50.654164 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6468cef-929c-42c6-a760-9fcf4ba64f95 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:50.659755 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 336/665] 10.222.0.70 () {56 vars in 1124 bytes} [Fri Aug 19 15:53:50 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:50.916644 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f772ea-a955-4ac3-b464-9836581c8d40 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:51.026438 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f772ea-a955-4ac3-b464-9836581c8d40 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:51.065828 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a8a2b-2953-4fbe-821f-d0efc7c2e6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:51.066548 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a8a2b-2953-4fbe-821f-d0efc7c2e6f4 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:51.066835 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a8a2b-2953-4fbe-821f-d0efc7c2e6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:51.067110 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a8a2b-2953-4fbe-821f-d0efc7c2e6f4 None admin] PATH_INFO: `/v3/services/network` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:51.067703 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901a8a2b-2953-4fbe-821f-d0efc7c2e6f4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:51.069104 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901a8a2b-2953-4fbe-821f-d0efc7c2e6f4 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:51.079081 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-901a8a2b-2953-4fbe-821f-d0efc7c2e6f4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 15:53:51.079081 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:51.079081 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 15:53:51.079081 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 15:53:51.079081 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 15:53:51.079081 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 15:53:51.079081 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 15:53:51.079081 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:53:51.079081 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 15:53:51.079081 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:53:51.079081 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 15:53:51.079081 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:53:51.079081 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:51.079081 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:51.079081 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:51.079081 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:51.079081 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:51.080123 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:51.080123 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:51.080123 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:51.080123 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:51.080123 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:51.080123 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:51.080123 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 15:53:51.080123 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 15:53:51.080123 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 15:53:51.080123 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 15:53:51.080123 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:51.080123 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:51.080123 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:51.080123 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:51.080123 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:51.080123 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:51.081414 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:51.081414 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:51.081414 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:51.081414 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:51.081414 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:51.081414 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:51.081414 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:51.081414 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:51.081414 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:51.081414 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:51.081414 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 15:53:51.081414 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:53:51.081414 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 15:53:51.081414 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:53:51.081414 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 330/666] 10.222.0.70 () {56 vars in 1111 bytes} [Fri Aug 19 15:53:50 2022] GET /identity/v3/services/network => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:51.086377 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6468cef-929c-42c6-a760-9fcf4ba64f95 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:51.204624 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6468cef-929c-42c6-a760-9fcf4ba64f95 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:51.250732 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42082a6e-f099-4950-9605-dfe19b06b6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:51.251355 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42082a6e-f099-4950-9605-dfe19b06b6e5 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:51.251636 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42082a6e-f099-4950-9605-dfe19b06b6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:51.251906 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42082a6e-f099-4950-9605-dfe19b06b6e5 None admin] PATH_INFO: `/v3/services` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:51.252544 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42082a6e-f099-4950-9605-dfe19b06b6e5 None admin] RBAC: Adding query filter params (name=network) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:51.253305 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42082a6e-f099-4950-9605-dfe19b06b6e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:51.254690 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42082a6e-f099-4950-9605-dfe19b06b6e5 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:51.260173 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 337/667] 10.222.0.70 () {56 vars in 1112 bytes} [Fri Aug 19 15:53:51 2022] GET /identity/v3/services?name=network => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:51.265754 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a8a2b-2953-4fbe-821f-d0efc7c2e6f4 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:51.302617 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:51.382095 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a8a2b-2953-4fbe-821f-d0efc7c2e6f4 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:51.422790 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c477dcac-94e5-4381-ae7d-20e7b3362373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:51.423428 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477dcac-94e5-4381-ae7d-20e7b3362373 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:51.423709 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477dcac-94e5-4381-ae7d-20e7b3362373 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:51.423983 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477dcac-94e5-4381-ae7d-20e7b3362373 None admin] PATH_INFO: `/v3/services` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:51.424627 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c477dcac-94e5-4381-ae7d-20e7b3362373 None admin] RBAC: Adding query filter params (type=network) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:51.424968 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c477dcac-94e5-4381-ae7d-20e7b3362373 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:51.426362 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c477dcac-94e5-4381-ae7d-20e7b3362373 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:51.433521 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 331/668] 10.222.0.70 () {56 vars in 1112 bytes} [Fri Aug 19 15:53:51 2022] GET /identity/v3/services?type=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:53:51.883494 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b81881-74b4-44d1-a5ce-02831252be38 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:51.884208 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b81881-74b4-44d1-a5ce-02831252be38 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:51.884776 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b81881-74b4-44d1-a5ce-02831252be38 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:51.886668 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 338/669] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:53:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:53:51.892466 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4825ec00-c344-46b8-9936-28087e0036e7 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:51.893099 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4825ec00-c344-46b8-9936-28087e0036e7 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:51.893577 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4825ec00-c344-46b8-9936-28087e0036e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:51.913298 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-4825ec00-c344-46b8-9936-28087e0036e7 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:53:51.914961 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-4825ec00-c344-46b8-9936-28087e0036e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:53:51.992774 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 332/670] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:53:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:53:52.343843 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b81881-74b4-44d1-a5ce-02831252be38 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:52.388476 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:52.474359 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b81881-74b4-44d1-a5ce-02831252be38 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:52.514627 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442dd804-6cbb-4089-8b69-d6dd304bb049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:52.515271 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442dd804-6cbb-4089-8b69-d6dd304bb049 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:52.515545 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442dd804-6cbb-4089-8b69-d6dd304bb049 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:52.515814 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442dd804-6cbb-4089-8b69-d6dd304bb049 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:52.530041 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442dd804-6cbb-4089-8b69-d6dd304bb049 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:53:52.535302 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-442dd804-6cbb-4089-8b69-d6dd304bb049 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:53:52.535302 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:52.535302 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:52.535302 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:52.535302 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:52.535302 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:52.535302 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:52.535302 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:52.535302 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:52.535302 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:52.535302 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:52.535302 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:52.535302 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:53:52.535302 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:53:52.535302 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:53:52.535302 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:53:52.536469 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:53:52.536469 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:53:52.536469 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:53:52.536469 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:53:52.536469 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:52.536469 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:52.536469 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:52.536469 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:52.536469 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:52.536469 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:52.536469 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:52.536469 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:52.536469 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:52.536469 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:52.536469 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:52.536469 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:52.537351 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:52.537351 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:52.537351 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:52.537351 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:52.537351 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:53:52.537351 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:53:52.537351 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:53:52.537351 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:53:52.537351 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:53:52.537351 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:53:52.537351 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:53:52.537351 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:52.540921 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 339/671] 10.222.0.70 () {56 vars in 1096 bytes} [Fri Aug 19 15:53:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:52.543341 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4825ec00-c344-46b8-9936-28087e0036e7 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:52.573865 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:52.593698 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6718f-e368-4d3f-88df-af1051c36d09 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:52.596659 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6718f-e368-4d3f-88df-af1051c36d09 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:52.596659 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6718f-e368-4d3f-88df-af1051c36d09 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:52.596659 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 340/672] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:53:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 15:53:52.602290 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5ea18-ba62-43c8-ac91-6f4c6172328c None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:52.602648 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5ea18-ba62-43c8-ac91-6f4c6172328c None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:52.602991 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5ea18-ba62-43c8-ac91-6f4c6172328c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:52.630391 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-6fd5ea18-ba62-43c8-ac91-6f4c6172328c None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:53:52.632081 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-6fd5ea18-ba62-43c8-ac91-6f4c6172328c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:53:52.674960 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4825ec00-c344-46b8-9936-28087e0036e7 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:52.728973 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 341/673] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:53:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 19 15:53:52.729247 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde8160-a41c-49c7-932b-65a57dff0602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:52.729247 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde8160-a41c-49c7-932b-65a57dff0602 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:52.729247 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde8160-a41c-49c7-932b-65a57dff0602 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:52.729247 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde8160-a41c-49c7-932b-65a57dff0602 None admin] PATH_INFO: `/v3/roles` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:52.729557 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde8160-a41c-49c7-932b-65a57dff0602 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:52.729557 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde8160-a41c-49c7-932b-65a57dff0602 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:52.730042 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde8160-a41c-49c7-932b-65a57dff0602 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:52.743493 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 333/674] 10.222.0.70 () {56 vars in 1099 bytes} [Fri Aug 19 15:53:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:52.746099 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5ea18-ba62-43c8-ac91-6f4c6172328c None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:52.769114 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:52.860136 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5ea18-ba62-43c8-ac91-6f4c6172328c None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:52.902623 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718c964-005b-42b9-af59-d901c9e94cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:52.903260 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718c964-005b-42b9-af59-d901c9e94cc4 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:52.903530 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718c964-005b-42b9-af59-d901c9e94cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:52.903797 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718c964-005b-42b9-af59-d901c9e94cc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:52.914758 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d718c964-005b-42b9-af59-d901c9e94cc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:52.917415 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d718c964-005b-42b9-af59-d901c9e94cc4 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:52.934076 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-d718c964-005b-42b9-af59-d901c9e94cc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:52.934076 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:52.934076 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:52.934076 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:52.934076 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:52.934076 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:52.934076 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:52.934076 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:52.934076 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:52.934076 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:52.934076 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:52.934076 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:52.934076 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:53:52.934076 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:53:52.934076 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:53:52.934076 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:53:52.935065 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:52.935065 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:52.935065 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:52.935065 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:52.935065 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:52.935065 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:52.935065 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:52.935065 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:52.935065 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:52.935065 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:52.935065 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:52.935065 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:52.935065 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:52.935065 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:52.935065 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:52.935065 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:52.935065 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:53:52.935950 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:53:52.935950 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:52.935950 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:52.939864 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 342/675] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:53:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:52.941302 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde8160-a41c-49c7-932b-65a57dff0602 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:53.023346 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173781b-37c4-46fc-938c-7ea03a15cd6a None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:53.023677 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173781b-37c4-46fc-938c-7ea03a15cd6a None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:53.023888 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173781b-37c4-46fc-938c-7ea03a15cd6a None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:53.025729 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 343/676] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:53:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:53:53.036966 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3bbbe0-d192-48af-bcd4-3a27bfd74e32 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:53.037420 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3bbbe0-d192-48af-bcd4-3a27bfd74e32 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:53.037813 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3bbbe0-d192-48af-bcd4-3a27bfd74e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:53.046808 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:53.057538 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-6a3bbbe0-d192-48af-bcd4-3a27bfd74e32 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:53:53.059445 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-6a3bbbe0-d192-48af-bcd4-3a27bfd74e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:53:53.061889 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde8160-a41c-49c7-932b-65a57dff0602 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:53.102726 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b80cd7-ddea-444d-8497-4737c755e2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:53.103483 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b80cd7-ddea-444d-8497-4737c755e2f0 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:53.103765 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b80cd7-ddea-444d-8497-4737c755e2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:53.104011 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b80cd7-ddea-444d-8497-4737c755e2f0 None admin] PATH_INFO: `/v3/domains` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:53.105017 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b80cd7-ddea-444d-8497-4737c755e2f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:53.105017 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b80cd7-ddea-444d-8497-4737c755e2f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:53.106320 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b80cd7-ddea-444d-8497-4737c755e2f0 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:53.125228 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 334/677] 10.222.0.70 () {56 vars in 1109 bytes} [Fri Aug 19 15:53:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:53.125228 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b80cd7-ddea-444d-8497-4737c755e2f0 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:53.141169 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 344/678] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:53:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 15:53:53.145364 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3bbbe0-d192-48af-bcd4-3a27bfd74e32 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:53.145364 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:53.256695 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b80cd7-ddea-444d-8497-4737c755e2f0 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:53.286121 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3bbbe0-d192-48af-bcd4-3a27bfd74e32 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:53.297212 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4311337-e6c4-488e-8be2-de24fb22a329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:53.297829 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4311337-e6c4-488e-8be2-de24fb22a329 None admin] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:53.298102 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4311337-e6c4-488e-8be2-de24fb22a329 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:53.298371 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4311337-e6c4-488e-8be2-de24fb22a329 None admin] PATH_INFO: `/v3/services` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:53.299019 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4311337-e6c4-488e-8be2-de24fb22a329 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:53.300384 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4311337-e6c4-488e-8be2-de24fb22a329 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:53.332070 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd388ae3-9155-41df-9825-e6ae18b68102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:53.333155 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd388ae3-9155-41df-9825-e6ae18b68102 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:53.333628 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd388ae3-9155-41df-9825-e6ae18b68102 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:53.334068 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd388ae3-9155-41df-9825-e6ae18b68102 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:53.343920 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd388ae3-9155-41df-9825-e6ae18b68102 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:53.346285 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd388ae3-9155-41df-9825-e6ae18b68102 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:53.365522 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-dd388ae3-9155-41df-9825-e6ae18b68102 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 15:53:53.365522 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:53.365522 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:53.365522 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:53.365522 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:53.365522 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:53.365522 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:53.365522 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:53.365522 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:53.365522 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:53.365522 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:53.365522 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:53.365522 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 15:53:53.365522 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 15:53:53.365522 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 15:53:53.365522 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 15:53:53.366547 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:53.366547 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:53.366547 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 15:53:53.366547 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:53:53.366547 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 15:53:53.366547 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:53:53.366547 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:53.366547 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:53.366547 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:53.366547 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:53.366547 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:53.366547 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:53.366547 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:53.366547 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:53.366547 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:53.366547 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:53.366547 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:53.366547 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:53.372677 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:53.372677 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:53.372677 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 15:53:53.372677 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 15:53:53.372677 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 15:53:53.372677 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 15:53:53.372677 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 15:53:53.372677 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 15:53:53.372677 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 15:53:53.372677 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:53.372677 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 345/679] 10.222.0.70 () {56 vars in 1093 bytes} [Fri Aug 19 15:53:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:53.374900 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd388ae3-9155-41df-9825-e6ae18b68102 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:53.442629 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:53.459657 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 335/680] 10.222.0.70 () {60 vars in 1141 bytes} [Fri Aug 19 15:53:53 2022] POST /identity/v3/services => generated 242 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:53:53.494902 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd388ae3-9155-41df-9825-e6ae18b68102 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:53.514226 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4311337-e6c4-488e-8be2-de24fb22a329 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:53.533104 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:53.553333 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b9d11a-af0c-4a9e-b8fd-8cb7ccb05c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:53.553960 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9d11a-af0c-4a9e-b8fd-8cb7ccb05c73 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:53.554434 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9d11a-af0c-4a9e-b8fd-8cb7ccb05c73 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:53.554706 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9d11a-af0c-4a9e-b8fd-8cb7ccb05c73 None admin] PATH_INFO: `/v3/users` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:53.555908 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b9d11a-af0c-4a9e-b8fd-8cb7ccb05c73 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:53.556248 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b9d11a-af0c-4a9e-b8fd-8cb7ccb05c73 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:53.558351 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b9d11a-af0c-4a9e-b8fd-8cb7ccb05c73 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:53.588733 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 346/681] 10.222.0.70 () {56 vars in 1133 bytes} [Fri Aug 19 15:53:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:53.592824 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b9d11a-af0c-4a9e-b8fd-8cb7ccb05c73 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:53.672320 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4311337-e6c4-488e-8be2-de24fb22a329 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:53.722008 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d0f77-7c8c-4843-8ad8-24268cf645c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:53.722635 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d0f77-7c8c-4843-8ad8-24268cf645c0 None admin] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:53.722916 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d0f77-7c8c-4843-8ad8-24268cf645c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:53.723352 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d0f77-7c8c-4843-8ad8-24268cf645c0 None admin] PATH_INFO: `/v3/services` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:53.724302 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d0f77-7c8c-4843-8ad8-24268cf645c0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:53.726437 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d0f77-7c8c-4843-8ad8-24268cf645c0 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:53.737215 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b9d11a-af0c-4a9e-b8fd-8cb7ccb05c73 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:53.756716 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:53.776418 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e6ea4d-9190-41f7-ab32-7ca836024291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:53.776970 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6ea4d-9190-41f7-ab32-7ca836024291 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:53.777244 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6ea4d-9190-41f7-ab32-7ca836024291 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:53.777511 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6ea4d-9190-41f7-ab32-7ca836024291 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:53.789825 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e6ea4d-9190-41f7-ab32-7ca836024291 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:53.791803 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e6ea4d-9190-41f7-ab32-7ca836024291 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:53.808438 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-f1e6ea4d-9190-41f7-ab32-7ca836024291 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:53.808438 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:53.808438 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:53.808438 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:53.808438 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:53.808438 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:53.808438 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:53.808438 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:53.808438 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:53.808438 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:53.808438 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:53.808438 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:53.808438 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:53:53.808438 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:53:53.808438 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:53:53.808438 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:53:53.809481 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:53.809481 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:53.809481 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:53.809481 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:53.809481 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:53.809481 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:53.809481 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:53.809481 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:53.809481 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:53.809481 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:53.809481 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:53.809481 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:53.809481 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:53.809481 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:53.809481 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:53.809481 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:53.809481 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:53:53.810414 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:53:53.810414 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:53.810414 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:53.810414 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 347/682] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:53:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:53:53.811460 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4e7bc-9001-4a7b-bbc3-5be9a0f0ad53 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:53.811460 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4e7bc-9001-4a7b-bbc3-5be9a0f0ad53 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:53.811460 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4e7bc-9001-4a7b-bbc3-5be9a0f0ad53 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:53.812779 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 348/683] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:53:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:53:53.818098 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe75ea-8b57-4409-b4cf-02512717d01c None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:53.818381 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe75ea-8b57-4409-b4cf-02512717d01c None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:53.818661 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe75ea-8b57-4409-b4cf-02512717d01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:53.823081 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 336/684] 10.222.0.70 () {60 vars in 1141 bytes} [Fri Aug 19 15:53:53 2022] POST /identity/v3/services => generated 251 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:53:53.823081 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d0f77-7c8c-4843-8ad8-24268cf645c0 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:53.840195 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-3cfe75ea-8b57-4409-b4cf-02512717d01c None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:53:53.841662 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-3cfe75ea-8b57-4409-b4cf-02512717d01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:53:53.930183 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 349/685] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:53:53 2022] POST /identity/v3/auth/tokens => generated 999 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 15:53:53.940384 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:53.983101 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d0f77-7c8c-4843-8ad8-24268cf645c0 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:54.023934 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae50a27-3fce-40ed-aa52-b11d73d80354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:54.024847 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae50a27-3fce-40ed-aa52-b11d73d80354 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:54.025404 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae50a27-3fce-40ed-aa52-b11d73d80354 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:54.025897 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae50a27-3fce-40ed-aa52-b11d73d80354 None admin] PATH_INFO: `/v3/domains` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:54.026702 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae50a27-3fce-40ed-aa52-b11d73d80354 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:54.027169 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae50a27-3fce-40ed-aa52-b11d73d80354 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:54.028792 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae50a27-3fce-40ed-aa52-b11d73d80354 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:54.043786 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 337/686] 10.222.0.70 () {56 vars in 1109 bytes} [Fri Aug 19 15:53:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:54.049677 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe75ea-8b57-4409-b4cf-02512717d01c None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:54.169079 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:54.176417 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe75ea-8b57-4409-b4cf-02512717d01c None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:54.215747 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f608c6f-0a75-46e7-a89d-f7292d5ac1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:54.216775 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f608c6f-0a75-46e7-a89d-f7292d5ac1e5 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:54.217273 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f608c6f-0a75-46e7-a89d-f7292d5ac1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:54.217738 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f608c6f-0a75-46e7-a89d-f7292d5ac1e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:54.225666 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f608c6f-0a75-46e7-a89d-f7292d5ac1e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:54.227575 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f608c6f-0a75-46e7-a89d-f7292d5ac1e5 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:54.240407 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-7f608c6f-0a75-46e7-a89d-f7292d5ac1e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:53:54.240407 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:54.240407 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:54.240407 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:54.240407 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:54.240407 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:54.240407 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:54.240407 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:54.240407 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:54.240407 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:54.240407 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:54.240407 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:54.240407 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 15:53:54.240407 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 15:53:54.240407 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 15:53:54.241342 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 15:53:54.241342 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:54.241342 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:54.241342 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:54.241342 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:54.241342 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:54.241342 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:54.241342 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:54.241342 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:54.241342 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:54.241342 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:54.241342 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:54.241342 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:54.241342 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:54.241342 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:54.241342 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:54.241342 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:54.242212 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 15:53:54.242212 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 15:53:54.242212 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 15:53:54.242212 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 15:53:54.242212 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 15:53:54.242212 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 15:53:54.242212 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:53:54.242212 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:54.249993 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 350/687] 10.222.0.70 () {56 vars in 1111 bytes} [Fri Aug 19 15:53:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:53:54.251747 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae50a27-3fce-40ed-aa52-b11d73d80354 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:54.276629 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f608c6f-0a75-46e7-a89d-f7292d5ac1e5 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:54.403262 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f608c6f-0a75-46e7-a89d-f7292d5ac1e5 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:54.415818 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae50a27-3fce-40ed-aa52-b11d73d80354 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:54.447761 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f87410-abf2-4980-9007-0aba475cb549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:54.448833 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f87410-abf2-4980-9007-0aba475cb549 None admin] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:54.449316 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f87410-abf2-4980-9007-0aba475cb549 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:54.449789 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f87410-abf2-4980-9007-0aba475cb549 None admin] PATH_INFO: `/v3/services` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:54.450662 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f87410-abf2-4980-9007-0aba475cb549 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:54.452317 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f87410-abf2-4980-9007-0aba475cb549 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:54.455646 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:54.466934 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa5878-ad4c-4527-b297-1cb4b79dc352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:54.469463 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa5878-ad4c-4527-b297-1cb4b79dc352 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:54.469463 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa5878-ad4c-4527-b297-1cb4b79dc352 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:54.469463 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa5878-ad4c-4527-b297-1cb4b79dc352 None admin] PATH_INFO: `/v3/projects` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:54.469463 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfa5878-ad4c-4527-b297-1cb4b79dc352 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:54.469463 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfa5878-ad4c-4527-b297-1cb4b79dc352 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:54.470815 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfa5878-ad4c-4527-b297-1cb4b79dc352 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:54.485079 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 338/688] 10.222.0.70 () {56 vars in 1148 bytes} [Fri Aug 19 15:53:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:54.490346 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa5878-ad4c-4527-b297-1cb4b79dc352 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:54.535822 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 351/689] 10.222.0.70 () {60 vars in 1141 bytes} [Fri Aug 19 15:53:54 2022] POST /identity/v3/services => generated 240 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:53:54.625653 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa5878-ad4c-4527-b297-1cb4b79dc352 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:54.683307 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf4102-21d6-41d4-8b9a-459c281cd967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:54.684007 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf4102-21d6-41d4-8b9a-459c281cd967 None admin] REQUEST_METHOD: `PUT` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:54.684284 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf4102-21d6-41d4-8b9a-459c281cd967 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:54.684555 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf4102-21d6-41d4-8b9a-459c281cd967 None admin] PATH_INFO: `/v3/projects/48fb7e21c6864d30b70ffca9093afec8/users/d90cec9e3ff64b5aa4cc867895b996ad/roles/2f6cb7d6ec874879972a12a63d61068d` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:54.689670 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bf4102-21d6-41d4-8b9a-459c281cd967 None admin] RBAC: Authorizing `identity:create_grant(project_id=48fb7e21c6864d30b70ffca9093afec8, user_id=d90cec9e3ff64b5aa4cc867895b996ad, role_id=2f6cb7d6ec874879972a12a63d61068d)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:54.691249 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bf4102-21d6-41d4-8b9a-459c281cd967 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:54.805970 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 339/690] 10.222.0.70 () {58 vars in 1439 bytes} [Fri Aug 19 15:53:54 2022] PUT /identity/v3/projects/48fb7e21c6864d30b70ffca9093afec8/users/d90cec9e3ff64b5aa4cc867895b996ad/roles/2f6cb7d6ec874879972a12a63d61068d => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:53:55.896488 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9769397-028d-4534-bbc3-01e8f06f2b77 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:55.897094 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9769397-028d-4534-bbc3-01e8f06f2b77 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:55.897582 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9769397-028d-4534-bbc3-01e8f06f2b77 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:55.899324 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 352/691] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:53:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:53:55.905494 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7643f-e4fd-4d67-8400-4d82377bb162 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:55.906062 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7643f-e4fd-4d67-8400-4d82377bb162 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:55.906566 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7643f-e4fd-4d67-8400-4d82377bb162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:55.926189 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-ade7643f-e4fd-4d67-8400-4d82377bb162 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:53:55.927383 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-ade7643f-e4fd-4d67-8400-4d82377bb162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:53:55.969730 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:55.999379 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 340/692] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:53:55 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:53:56.253552 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a066e-2b3e-4595-a57f-95e191755252 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:56.254247 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a066e-2b3e-4595-a57f-95e191755252 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:56.254755 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a066e-2b3e-4595-a57f-95e191755252 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:56.256531 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 353/693] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:53:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:53:56.262279 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ecaab-5dce-4996-8b1c-e3b1970897fd None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:56.262806 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ecaab-5dce-4996-8b1c-e3b1970897fd None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:56.263284 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ecaab-5dce-4996-8b1c-e3b1970897fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:56.282622 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-377ecaab-5dce-4996-8b1c-e3b1970897fd None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:53:56.284113 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-377ecaab-5dce-4996-8b1c-e3b1970897fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:53:56.343132 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a066e-2b3e-4595-a57f-95e191755252 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:56.368315 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:56.372231 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 341/694] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:53:56 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:53:56.468550 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a066e-2b3e-4595-a57f-95e191755252 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:56.506812 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f745af16-c6d9-4711-bdf2-bb1ffa29cc7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:56.508054 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745af16-c6d9-4711-bdf2-bb1ffa29cc7b None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:56.508545 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745af16-c6d9-4711-bdf2-bb1ffa29cc7b None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:56.509052 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745af16-c6d9-4711-bdf2-bb1ffa29cc7b None admin] PATH_INFO: `/v3/services/image` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:56.510344 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f745af16-c6d9-4711-bdf2-bb1ffa29cc7b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:56.511942 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f745af16-c6d9-4711-bdf2-bb1ffa29cc7b None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:56.521667 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-f745af16-c6d9-4711-bdf2-bb1ffa29cc7b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 15:53:56.521667 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:56.521667 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 15:53:56.521667 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 15:53:56.521667 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 15:53:56.521667 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 15:53:56.521667 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 15:53:56.521667 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:53:56.521667 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 15:53:56.521667 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:56.521667 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 15:53:56.521667 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:56.521667 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:56.521667 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:56.521667 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:56.521667 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:56.521667 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:56.522763 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:56.522763 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:56.522763 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:56.522763 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:56.522763 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:56.522763 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:56.522763 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 15:53:56.522763 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 15:53:56.522763 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 15:53:56.522763 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 15:53:56.522763 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:56.522763 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:56.522763 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:56.522763 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:56.522763 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:56.522763 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:56.523691 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:56.523691 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:56.523691 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:56.523691 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:56.523691 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:56.523691 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:56.523691 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:56.523691 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:56.523691 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:56.523691 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:56.523691 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 15:53:56.523691 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:53:56.523691 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 15:53:56.523691 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:56.532214 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 354/695] 10.222.0.70 () {56 vars in 1105 bytes} [Fri Aug 19 15:53:56 2022] GET /identity/v3/services/image => generated 86 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:56.534029 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ecaab-5dce-4996-8b1c-e3b1970897fd None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:56.651266 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ecaab-5dce-4996-8b1c-e3b1970897fd None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:56.654184 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:56.689216 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a84cd5e-56d3-487d-8218-c3f1753fabd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:56.690206 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84cd5e-56d3-487d-8218-c3f1753fabd9 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:56.690708 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84cd5e-56d3-487d-8218-c3f1753fabd9 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:56.691192 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84cd5e-56d3-487d-8218-c3f1753fabd9 None admin] PATH_INFO: `/v3/services` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:56.692034 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a84cd5e-56d3-487d-8218-c3f1753fabd9 None admin] RBAC: Adding query filter params (name=image) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:56.692584 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a84cd5e-56d3-487d-8218-c3f1753fabd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:56.694292 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a84cd5e-56d3-487d-8218-c3f1753fabd9 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:56.703598 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 342/696] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:53:56 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:56.706265 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f745af16-c6d9-4711-bdf2-bb1ffa29cc7b None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:56.718555 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a84cd5e-56d3-487d-8218-c3f1753fabd9 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:56.815701 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:56.843381 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a84cd5e-56d3-487d-8218-c3f1753fabd9 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:56.849562 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f745af16-c6d9-4711-bdf2-bb1ffa29cc7b None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:56.888995 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c2001-ebac-49d6-af38-2bfbd5e9d1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:56.890172 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c2001-ebac-49d6-af38-2bfbd5e9d1df None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:56.890646 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c2001-ebac-49d6-af38-2bfbd5e9d1df None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:56.891021 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8bbe64-3108-49f4-be43-823b0b83b8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:56.891365 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c2001-ebac-49d6-af38-2bfbd5e9d1df None admin] PATH_INFO: `/v3/services` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:56.891658 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8bbe64-3108-49f4-be43-823b0b83b8a0 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:56.891937 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8bbe64-3108-49f4-be43-823b0b83b8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:56.892231 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8bbe64-3108-49f4-be43-823b0b83b8a0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:56.892829 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7c2001-ebac-49d6-af38-2bfbd5e9d1df None admin] RBAC: Adding query filter params (type=image) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:56.892948 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8bbe64-3108-49f4-be43-823b0b83b8a0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:56.893448 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7c2001-ebac-49d6-af38-2bfbd5e9d1df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:56.894283 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8bbe64-3108-49f4-be43-823b0b83b8a0 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:56.895201 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7c2001-ebac-49d6-af38-2bfbd5e9d1df None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:56.902218 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 355/697] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:53:56 2022] GET /identity/v3/services?type=image => generated 350 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:56.908003 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-2c8bbe64-3108-49f4-be43-823b0b83b8a0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 15:53:56.908003 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:56.908003 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 15:53:56.908003 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 15:53:56.908003 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 15:53:56.908003 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 15:53:56.908003 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 15:53:56.908003 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:53:56.908003 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 15:53:56.908003 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:53:56.908003 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 15:53:56.908003 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:53:56.908003 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:56.908003 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:56.908003 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:56.908003 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:56.908003 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:56.909268 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:56.909268 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:56.909268 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:56.909268 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:56.909268 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:56.909268 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:56.909268 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 15:53:56.909268 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 15:53:56.909268 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 15:53:56.909268 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 15:53:56.909268 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:56.909268 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:56.909268 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:56.909268 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:56.909268 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:56.909268 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:56.910119 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:56.910119 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:56.910119 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:56.910119 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:56.910119 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:56.910119 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:56.910119 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:56.910119 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:56.910119 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:56.910119 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:56.910119 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 15:53:56.910119 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:53:56.910119 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 15:53:56.910119 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:53:56.910838 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c2001-ebac-49d6-af38-2bfbd5e9d1df None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:56.918065 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 343/698] 10.222.0.70 () {56 vars in 1129 bytes} [Fri Aug 19 15:53:56 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:56.919903 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8bbe64-3108-49f4-be43-823b0b83b8a0 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:56.955805 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:57.033102 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c2001-ebac-49d6-af38-2bfbd5e9d1df None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:57.035514 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8bbe64-3108-49f4-be43-823b0b83b8a0 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:57.070248 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3542a-dd04-48a3-a027-7e8ecc29db84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:57.070873 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3542a-dd04-48a3-a027-7e8ecc29db84 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:57.071202 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7d3a2-f9df-4aac-b0f0-823966e713ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:57.071325 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3542a-dd04-48a3-a027-7e8ecc29db84 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:57.071521 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3542a-dd04-48a3-a027-7e8ecc29db84 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:57.071815 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7d3a2-f9df-4aac-b0f0-823966e713ae None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:57.072757 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7d3a2-f9df-4aac-b0f0-823966e713ae None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:57.073032 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7d3a2-f9df-4aac-b0f0-823966e713ae None admin] PATH_INFO: `/v3/services` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:57.073351 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c3542a-dd04-48a3-a027-7e8ecc29db84 None admin] RBAC: Adding query filter params (interface=public, service_id=204c96c791424824b4ad4219c1a74090, region_id=RegionOne) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:57.073656 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b7d3a2-f9df-4aac-b0f0-823966e713ae None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:57.073763 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c3542a-dd04-48a3-a027-7e8ecc29db84 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:57.073956 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b7d3a2-f9df-4aac-b0f0-823966e713ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:57.075052 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c3542a-dd04-48a3-a027-7e8ecc29db84 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:57.075304 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b7d3a2-f9df-4aac-b0f0-823966e713ae None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:57.080940 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 344/699] 10.222.0.70 () {56 vars in 1124 bytes} [Fri Aug 19 15:53:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:53:57.081997 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe7c2fd-feab-4098-9f62-cb921fd0efaf None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:57.082276 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe7c2fd-feab-4098-9f62-cb921fd0efaf None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:57.082547 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe7c2fd-feab-4098-9f62-cb921fd0efaf None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:57.083887 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 345/700] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:53:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:53:57.086032 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe7c2fd-feab-4098-9f62-cb921fd0efaf None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:57.089981 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 356/701] 10.222.0.70 () {56 vars in 1251 bytes} [Fri Aug 19 15:53:56 2022] GET /identity/v3/endpoints?service_id=204c96c791424824b4ad4219c1a74090&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:53:57.092447 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f850eab-edeb-4b92-8004-c5e8945debcd None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:57.093017 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f850eab-edeb-4b92-8004-c5e8945debcd None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:57.093512 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f850eab-edeb-4b92-8004-c5e8945debcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:57.107957 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:57.113808 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-9f850eab-edeb-4b92-8004-c5e8945debcd None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:53:57.115083 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-9f850eab-edeb-4b92-8004-c5e8945debcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:53:57.183003 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 357/702] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:53:57 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:53:57.184252 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f850eab-edeb-4b92-8004-c5e8945debcd None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:57.197987 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:57.204559 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe7c2fd-feab-4098-9f62-cb921fd0efaf None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:57.239013 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1549ae-7443-4faf-a51e-4b67877150ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:57.239611 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1549ae-7443-4faf-a51e-4b67877150ae None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:57.239884 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1549ae-7443-4faf-a51e-4b67877150ae None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:57.240149 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1549ae-7443-4faf-a51e-4b67877150ae None admin] PATH_INFO: `/v3/services` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:57.240803 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1549ae-7443-4faf-a51e-4b67877150ae None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:57.241159 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1549ae-7443-4faf-a51e-4b67877150ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:57.242551 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1549ae-7443-4faf-a51e-4b67877150ae None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:57.253534 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 346/703] 10.222.0.70 () {56 vars in 1124 bytes} [Fri Aug 19 15:53:57 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:53:57.253534 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50518e78-b199-4c65-b8e0-28c13e173b11 None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:57.253534 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50518e78-b199-4c65-b8e0-28c13e173b11 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:57.253534 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50518e78-b199-4c65-b8e0-28c13e173b11 None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:57.255845 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 347/704] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:53:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:53:57.256624 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50518e78-b199-4c65-b8e0-28c13e173b11 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:57.305801 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f850eab-edeb-4b92-8004-c5e8945debcd None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:57.348163 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa49f5-1c63-48d9-8df1-c5b5c99f766b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:57.348709 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa49f5-1c63-48d9-8df1-c5b5c99f766b None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:57.349000 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa49f5-1c63-48d9-8df1-c5b5c99f766b None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:57.349271 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa49f5-1c63-48d9-8df1-c5b5c99f766b None admin] PATH_INFO: `/v3/services` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:57.349887 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa49f5-1c63-48d9-8df1-c5b5c99f766b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:57.351297 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa49f5-1c63-48d9-8df1-c5b5c99f766b None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:57.354491 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:57.368735 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 358/705] 10.222.0.70 () {56 vars in 1087 bytes} [Fri Aug 19 15:53:57 2022] GET /identity/v3/services => generated 1002 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:53:57.368735 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64840cc3-707c-4c85-b0a0-1ae2a5f455cf None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:57.368735 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64840cc3-707c-4c85-b0a0-1ae2a5f455cf None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:57.368735 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64840cc3-707c-4c85-b0a0-1ae2a5f455cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:57.382738 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-64840cc3-707c-4c85-b0a0-1ae2a5f455cf None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:53:57.383066 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50518e78-b199-4c65-b8e0-28c13e173b11 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:57.384023 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-64840cc3-707c-4c85-b0a0-1ae2a5f455cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:53:57.436676 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95d4be-67b5-43d3-9991-eea70e1bf4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:57.437514 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95d4be-67b5-43d3-9991-eea70e1bf4e9 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:57.437792 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95d4be-67b5-43d3-9991-eea70e1bf4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:57.438062 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95d4be-67b5-43d3-9991-eea70e1bf4e9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:57.438781 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c95d4be-67b5-43d3-9991-eea70e1bf4e9 None admin] RBAC: Adding query filter params (interface=public, service_id=91f4a679069945b884135fc15bdbee18, region_id=RegionOne) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:57.439088 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c95d4be-67b5-43d3-9991-eea70e1bf4e9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:57.441075 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c95d4be-67b5-43d3-9991-eea70e1bf4e9 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:57.456855 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 348/706] 10.222.0.70 () {56 vars in 1251 bytes} [Fri Aug 19 15:53:57 2022] GET /identity/v3/endpoints?service_id=91f4a679069945b884135fc15bdbee18&interface=public®ion_id=RegionOne => generated 194 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:57.460891 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95d4be-67b5-43d3-9991-eea70e1bf4e9 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:57.490144 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 359/707] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:53:57 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:53:57.507696 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:57.526769 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64840cc3-707c-4c85-b0a0-1ae2a5f455cf None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:57.610417 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95d4be-67b5-43d3-9991-eea70e1bf4e9 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:57.653514 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af38cd-2767-4f40-a73d-d0ac3ce728c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:57.654636 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af38cd-2767-4f40-a73d-d0ac3ce728c4 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:57.655097 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af38cd-2767-4f40-a73d-d0ac3ce728c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:57.655547 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af38cd-2767-4f40-a73d-d0ac3ce728c4 None admin] PATH_INFO: `/v3/services` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:57.656329 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af38cd-2767-4f40-a73d-d0ac3ce728c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:57.658137 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af38cd-2767-4f40-a73d-d0ac3ce728c4 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:57.665097 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 349/708] 10.222.0.70 () {56 vars in 1087 bytes} [Fri Aug 19 15:53:57 2022] GET /identity/v3/services => generated 1002 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:53:57.677623 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64840cc3-707c-4c85-b0a0-1ae2a5f455cf None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:57.716790 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:57.723562 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57bba1a-752a-49ab-8a0f-652982f08a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:57.724607 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57bba1a-752a-49ab-8a0f-652982f08a02 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:57.725169 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57bba1a-752a-49ab-8a0f-652982f08a02 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:57.725659 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57bba1a-752a-49ab-8a0f-652982f08a02 None admin] PATH_INFO: `/v3/services/network` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:57.726557 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57bba1a-752a-49ab-8a0f-652982f08a02 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:57.729025 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57bba1a-752a-49ab-8a0f-652982f08a02 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:57.739621 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-a57bba1a-752a-49ab-8a0f-652982f08a02 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 15:53:57.739621 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:57.739621 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 15:53:57.739621 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 15:53:57.739621 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 15:53:57.739621 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 15:53:57.739621 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 15:53:57.739621 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:53:57.739621 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 15:53:57.739621 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:57.739621 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 15:53:57.739621 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:57.739621 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:57.739621 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:57.739621 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:57.739621 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:57.739621 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:57.740751 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:57.740751 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:57.740751 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:57.740751 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:57.740751 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:57.740751 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:57.740751 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 15:53:57.740751 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 15:53:57.740751 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 15:53:57.740751 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 15:53:57.740751 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:57.740751 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:57.740751 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:57.740751 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:57.740751 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:57.740751 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:57.741613 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:57.741613 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:57.741613 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:57.741613 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:57.741613 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:57.741613 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:57.741613 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:57.741613 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:57.741613 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:57.741613 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:57.741613 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 15:53:57.741613 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:53:57.741613 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 15:53:57.741613 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:57.744338 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 360/709] 10.222.0.70 () {56 vars in 1111 bytes} [Fri Aug 19 15:53:57 2022] GET /identity/v3/services/network => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:53:57.751595 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af38cd-2767-4f40-a73d-d0ac3ce728c4 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:57.832736 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57bba1a-752a-49ab-8a0f-652982f08a02 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:57.859255 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:57.877269 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af38cd-2767-4f40-a73d-d0ac3ce728c4 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:57.938092 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da39e41d-0046-4c35-bcc8-989bf2ae4c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:57.939679 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39e41d-0046-4c35-bcc8-989bf2ae4c9f None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:57.940574 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39e41d-0046-4c35-bcc8-989bf2ae4c9f None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:57.941067 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39e41d-0046-4c35-bcc8-989bf2ae4c9f None admin] PATH_INFO: `/v3/services` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:57.942504 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da39e41d-0046-4c35-bcc8-989bf2ae4c9f None admin] RBAC: Adding query filter params (name=network) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:57.943317 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da39e41d-0046-4c35-bcc8-989bf2ae4c9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:57.946612 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da39e41d-0046-4c35-bcc8-989bf2ae4c9f None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:57.955895 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 350/710] 10.222.0.70 () {56 vars in 1112 bytes} [Fri Aug 19 15:53:57 2022] GET /identity/v3/services?name=network => generated 124 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:57.960707 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57bba1a-752a-49ab-8a0f-652982f08a02 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:57.961395 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da39e41d-0046-4c35-bcc8-989bf2ae4c9f None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:58.004062 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f8ee3-6f87-46f0-9b62-0e913da1e4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:58.004990 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f8ee3-6f87-46f0-9b62-0e913da1e4cc None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:58.005444 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f8ee3-6f87-46f0-9b62-0e913da1e4cc None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:58.005855 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f8ee3-6f87-46f0-9b62-0e913da1e4cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:58.018881 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f8ee3-6f87-46f0-9b62-0e913da1e4cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:53:58.025099 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-e12f8ee3-6f87-46f0-9b62-0e913da1e4cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:53:58.025099 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:58.025099 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:58.025099 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:58.025099 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:58.025099 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:58.025099 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:58.025099 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:58.025099 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:58.025099 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:58.025099 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:58.025099 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:58.025099 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:53:58.025099 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:53:58.025099 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:53:58.025099 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:53:58.026477 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:53:58.026477 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:53:58.026477 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:53:58.026477 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:53:58.026477 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:58.026477 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:58.026477 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:58.026477 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:58.026477 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:58.026477 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:58.026477 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:58.026477 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:58.026477 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:58.026477 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:58.026477 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:58.026477 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:58.027520 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:58.027520 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:58.027520 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:58.027520 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:58.027520 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:53:58.027520 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:53:58.027520 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:53:58.027520 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:53:58.027520 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:53:58.027520 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:53:58.027520 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:53:58.027520 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:58.029976 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 361/711] 10.222.0.70 () {56 vars in 1096 bytes} [Fri Aug 19 15:53:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:53:58.041094 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f8ee3-6f87-46f0-9b62-0e913da1e4cc None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:58.083217 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da39e41d-0046-4c35-bcc8-989bf2ae4c9f None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:58.095926 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:58.121189 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1566cb9-9b14-470b-b5a8-605ac2bf98d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:58.121810 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1566cb9-9b14-470b-b5a8-605ac2bf98d4 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:58.122153 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1566cb9-9b14-470b-b5a8-605ac2bf98d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:58.122428 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1566cb9-9b14-470b-b5a8-605ac2bf98d4 None admin] PATH_INFO: `/v3/services` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:58.123065 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1566cb9-9b14-470b-b5a8-605ac2bf98d4 None admin] RBAC: Adding query filter params (type=network) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:58.123364 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1566cb9-9b14-470b-b5a8-605ac2bf98d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:58.124801 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1566cb9-9b14-470b-b5a8-605ac2bf98d4 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:58.130769 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 351/712] 10.222.0.70 () {56 vars in 1112 bytes} [Fri Aug 19 15:53:57 2022] GET /identity/v3/services?type=network => generated 350 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:53:58.137069 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1566cb9-9b14-470b-b5a8-605ac2bf98d4 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:58.150746 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f8ee3-6f87-46f0-9b62-0e913da1e4cc None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:58.173087 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:58.195058 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17369ccd-6d45-44f6-97dd-ccdd2f1bfbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:58.195947 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17369ccd-6d45-44f6-97dd-ccdd2f1bfbe7 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:58.196230 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17369ccd-6d45-44f6-97dd-ccdd2f1bfbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:58.196504 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17369ccd-6d45-44f6-97dd-ccdd2f1bfbe7 None admin] PATH_INFO: `/v3/roles` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:58.197754 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17369ccd-6d45-44f6-97dd-ccdd2f1bfbe7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:58.198216 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17369ccd-6d45-44f6-97dd-ccdd2f1bfbe7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:58.200410 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17369ccd-6d45-44f6-97dd-ccdd2f1bfbe7 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:58.211945 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 362/713] 10.222.0.70 () {56 vars in 1099 bytes} [Fri Aug 19 15:53:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:58.218717 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17369ccd-6d45-44f6-97dd-ccdd2f1bfbe7 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:58.267444 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1566cb9-9b14-470b-b5a8-605ac2bf98d4 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:58.305918 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ecfd3-81ab-4a87-97a5-0f84fea6d1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:58.306866 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ecfd3-81ab-4a87-97a5-0f84fea6d1cf None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:58.307715 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ecfd3-81ab-4a87-97a5-0f84fea6d1cf None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:58.308060 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ecfd3-81ab-4a87-97a5-0f84fea6d1cf None admin] PATH_INFO: `/v3/endpoints` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:58.308894 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ecfd3-81ab-4a87-97a5-0f84fea6d1cf None admin] RBAC: Adding query filter params (interface=public, service_id=c6d02a4a07bf4fc18eb8065ab05d631a, region_id=RegionOne) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:58.309274 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ecfd3-81ab-4a87-97a5-0f84fea6d1cf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:58.310855 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ecfd3-81ab-4a87-97a5-0f84fea6d1cf None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:58.321059 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 352/714] 10.222.0.70 () {56 vars in 1251 bytes} [Fri Aug 19 15:53:58 2022] GET /identity/v3/endpoints?service_id=c6d02a4a07bf4fc18eb8065ab05d631a&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:53:58.323671 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ecfd3-81ab-4a87-97a5-0f84fea6d1cf None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:58.337029 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17369ccd-6d45-44f6-97dd-ccdd2f1bfbe7 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:58.360408 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:58.378071 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09bfcc4-9032-4b1f-80b7-2852e2a5d85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:58.378805 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09bfcc4-9032-4b1f-80b7-2852e2a5d85f None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:58.379378 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09bfcc4-9032-4b1f-80b7-2852e2a5d85f None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:58.379378 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09bfcc4-9032-4b1f-80b7-2852e2a5d85f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:58.392758 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09bfcc4-9032-4b1f-80b7-2852e2a5d85f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:58.394246 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09bfcc4-9032-4b1f-80b7-2852e2a5d85f None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:58.412152 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-f09bfcc4-9032-4b1f-80b7-2852e2a5d85f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:58.412152 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:58.412152 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:58.412152 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:58.412152 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:58.412152 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:58.412152 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:58.412152 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:58.412152 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:58.412152 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:58.412152 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:58.412152 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:58.412152 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:53:58.412152 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:53:58.412152 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:53:58.412152 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:53:58.413809 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:58.413809 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:58.413809 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:58.413809 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:58.413809 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:58.413809 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:58.413809 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:58.413809 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:58.413809 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:58.413809 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:58.413809 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:58.413809 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:58.413809 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:58.413809 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:58.413809 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:58.413809 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:58.413809 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:53:58.414743 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:53:58.414743 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:58.414743 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:58.418555 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 363/715] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:53:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:53:58.421376 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09bfcc4-9032-4b1f-80b7-2852e2a5d85f None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:58.442872 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:58.465215 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ecfd3-81ab-4a87-97a5-0f84fea6d1cf None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:58.506299 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371df8b-b5c0-4c8c-8d28-a75df808723c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:58.507812 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371df8b-b5c0-4c8c-8d28-a75df808723c None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:58.508531 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371df8b-b5c0-4c8c-8d28-a75df808723c None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:58.509029 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371df8b-b5c0-4c8c-8d28-a75df808723c None admin] PATH_INFO: `/v3/services` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:58.509918 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371df8b-b5c0-4c8c-8d28-a75df808723c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:58.512180 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371df8b-b5c0-4c8c-8d28-a75df808723c None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:58.525168 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 353/716] 10.222.0.70 () {56 vars in 1087 bytes} [Fri Aug 19 15:53:58 2022] GET /identity/v3/services => generated 1002 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 15:53:58.533725 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09bfcc4-9032-4b1f-80b7-2852e2a5d85f None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:58.581352 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa6aa6-f44e-4221-8712-19a684183060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:58.581976 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa6aa6-f44e-4221-8712-19a684183060 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:58.582251 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa6aa6-f44e-4221-8712-19a684183060 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:58.582517 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa6aa6-f44e-4221-8712-19a684183060 None admin] PATH_INFO: `/v3/domains` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:58.583165 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfa6aa6-f44e-4221-8712-19a684183060 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:58.583460 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfa6aa6-f44e-4221-8712-19a684183060 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:58.584883 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfa6aa6-f44e-4221-8712-19a684183060 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:58.599789 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 364/717] 10.222.0.70 () {56 vars in 1109 bytes} [Fri Aug 19 15:53:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:53:58.605889 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371df8b-b5c0-4c8c-8d28-a75df808723c None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:58.733751 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371df8b-b5c0-4c8c-8d28-a75df808723c None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:58.781524 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc33fe-67b1-454d-8124-6d228438134d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:58.782072 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc33fe-67b1-454d-8124-6d228438134d None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:58.782355 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc33fe-67b1-454d-8124-6d228438134d None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:58.782624 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc33fe-67b1-454d-8124-6d228438134d None admin] PATH_INFO: `/v3/users/nova` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:58.798087 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bc33fe-67b1-454d-8124-6d228438134d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:58.798557 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bc33fe-67b1-454d-8124-6d228438134d None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:58.813046 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-91bc33fe-67b1-454d-8124-6d228438134d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 15:53:58.813046 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:58.813046 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:58.813046 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:58.813046 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:58.813046 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:58.813046 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:58.813046 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:58.813046 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:58.813046 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:58.813046 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:58.813046 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:58.813046 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 15:53:58.813046 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 15:53:58.813046 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 15:53:58.813046 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 15:53:58.814072 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:58.814072 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:58.814072 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 15:53:58.814072 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:53:58.814072 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 15:53:58.814072 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:53:58.814072 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:58.814072 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:58.814072 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:58.814072 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:58.814072 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:58.814072 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:58.814072 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:58.814072 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:58.814072 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:58.814072 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:58.814072 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:58.814072 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:58.815024 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:58.815024 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:58.815024 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 15:53:58.815024 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 15:53:58.815024 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 15:53:58.815024 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 15:53:58.815024 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 15:53:58.815024 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 15:53:58.815024 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 15:53:58.815024 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:53:58.815024 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 354/718] 10.222.0.70 () {56 vars in 1093 bytes} [Fri Aug 19 15:53:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:58.820303 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa6aa6-f44e-4221-8712-19a684183060 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:58.855117 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:58.944919 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa6aa6-f44e-4221-8712-19a684183060 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:58.982497 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000cae64-07d1-4bde-a534-76b66d7c082d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:58.983139 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000cae64-07d1-4bde-a534-76b66d7c082d None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:58.983416 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000cae64-07d1-4bde-a534-76b66d7c082d None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:58.983638 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000cae64-07d1-4bde-a534-76b66d7c082d None admin] PATH_INFO: `/v3/users` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:58.984541 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000cae64-07d1-4bde-a534-76b66d7c082d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:58.984823 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000cae64-07d1-4bde-a534-76b66d7c082d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:58.986265 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000cae64-07d1-4bde-a534-76b66d7c082d None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:59.009132 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 365/719] 10.222.0.70 () {56 vars in 1133 bytes} [Fri Aug 19 15:53:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:59.015277 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc33fe-67b1-454d-8124-6d228438134d None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:59.020251 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:59.127228 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc33fe-67b1-454d-8124-6d228438134d None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:59.168878 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e9871-f3d2-4400-8bc2-6f89ff8e0715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:59.169490 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e9871-f3d2-4400-8bc2-6f89ff8e0715 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:59.169765 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e9871-f3d2-4400-8bc2-6f89ff8e0715 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:59.170034 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e9871-f3d2-4400-8bc2-6f89ff8e0715 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:59.248389 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e9871-f3d2-4400-8bc2-6f89ff8e0715 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:59.249854 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e9871-f3d2-4400-8bc2-6f89ff8e0715 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:59.252536 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:59.362797 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 355/720] 10.222.0.70 () {58 vars in 1282 bytes} [Fri Aug 19 15:53:59 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 15:53:59.368941 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000cae64-07d1-4bde-a534-76b66d7c082d None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:59.469166 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:59.481111 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000cae64-07d1-4bde-a534-76b66d7c082d None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:59.518233 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016e9e8e-b921-417f-b2fb-fc6139df9cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:59.518786 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e9e8e-b921-417f-b2fb-fc6139df9cc9 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:59.519112 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e9e8e-b921-417f-b2fb-fc6139df9cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:59.519387 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e9e8e-b921-417f-b2fb-fc6139df9cc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:59.531639 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016e9e8e-b921-417f-b2fb-fc6139df9cc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:59.533148 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016e9e8e-b921-417f-b2fb-fc6139df9cc9 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:59.549112 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-016e9e8e-b921-417f-b2fb-fc6139df9cc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:59.549112 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:59.549112 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:59.549112 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:59.549112 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:59.549112 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:59.549112 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:59.549112 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:59.549112 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:59.549112 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:59.549112 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:59.549112 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:59.549112 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:53:59.549112 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:53:59.549112 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:53:59.549112 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:53:59.550071 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:59.550071 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:59.550071 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:59.550071 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:59.550071 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:59.550071 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:59.550071 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:59.550071 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:59.550071 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:59.550071 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:59.550071 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:59.550071 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:59.550071 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:59.550071 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:59.550071 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:59.550071 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:59.550071 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:53:59.550958 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:53:59.550958 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:53:59.550958 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:59.550958 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 366/721] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:53:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:59.556289 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e9871-f3d2-4400-8bc2-6f89ff8e0715 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:59.674834 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e9871-f3d2-4400-8bc2-6f89ff8e0715 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:59.693716 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:59.712340 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d8401-d2c8-4154-8950-3aff5bec3077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:59.714020 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d8401-d2c8-4154-8950-3aff5bec3077 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:59.714398 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d8401-d2c8-4154-8950-3aff5bec3077 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:59.714671 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d8401-d2c8-4154-8950-3aff5bec3077 None admin] PATH_INFO: `/v3/domains` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:59.715323 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4d8401-d2c8-4154-8950-3aff5bec3077 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:53:59.715622 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4d8401-d2c8-4154-8950-3aff5bec3077 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:59.717148 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4d8401-d2c8-4154-8950-3aff5bec3077 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:59.734358 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 356/722] 10.222.0.70 () {56 vars in 1109 bytes} [Fri Aug 19 15:53:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:53:59.736802 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016e9e8e-b921-417f-b2fb-fc6139df9cc9 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:59.824715 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304b9ac-f84c-4c98-98b6-701e782b4a05 None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:59.824907 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304b9ac-f84c-4c98-98b6-701e782b4a05 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:59.825296 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304b9ac-f84c-4c98-98b6-701e782b4a05 None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:59.826948 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 357/723] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:53:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 15:53:59.835789 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d7c41-2997-46b9-8bc1-dbd3b2a6b410 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:59.836296 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d7c41-2997-46b9-8bc1-dbd3b2a6b410 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:59.836753 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d7c41-2997-46b9-8bc1-dbd3b2a6b410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:59.860975 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-374d7c41-2997-46b9-8bc1-dbd3b2a6b410 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:53:59.862710 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-374d7c41-2997-46b9-8bc1-dbd3b2a6b410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:53:59.867565 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016e9e8e-b921-417f-b2fb-fc6139df9cc9 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:53:59.912068 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9743b289-b295-4ef1-9e0a-d142fe1d2e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:53:59.912741 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743b289-b295-4ef1-9e0a-d142fe1d2e1d None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:53:59.913084 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743b289-b295-4ef1-9e0a-d142fe1d2e1d None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:53:59.913300 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743b289-b295-4ef1-9e0a-d142fe1d2e1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:53:59.922661 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9743b289-b295-4ef1-9e0a-d142fe1d2e1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:53:59.924595 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9743b289-b295-4ef1-9e0a-d142fe1d2e1d None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:53:59.926762 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:53:59.941075 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-9743b289-b295-4ef1-9e0a-d142fe1d2e1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:53:59.941075 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:53:59.941075 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:53:59.941075 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:53:59.941075 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:53:59.941075 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:53:59.941075 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:53:59.941075 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:53:59.941075 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:53:59.941075 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:53:59.941075 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:53:59.941075 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:53:59.941075 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 15:53:59.941075 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 15:53:59.941075 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 15:53:59.942064 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 15:53:59.942064 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:53:59.942064 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:53:59.942064 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:53:59.942064 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:53:59.942064 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:53:59.942064 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:53:59.942064 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:53:59.942064 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:53:59.942064 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:53:59.942064 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:53:59.942064 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:53:59.942064 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:53:59.942064 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:53:59.942064 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:53:59.942064 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:53:59.942064 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:53:59.942940 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 15:53:59.942940 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 15:53:59.942940 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 15:53:59.942940 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 15:53:59.942940 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 15:53:59.942940 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 15:53:59.942940 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:53:59.942940 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:53:59.947974 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 367/724] 10.222.0.70 () {56 vars in 1111 bytes} [Fri Aug 19 15:53:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:53:59.949600 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9743b289-b295-4ef1-9e0a-d142fe1d2e1d None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:53:59.972812 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 358/725] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:53:59 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 15:54:00.021015 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68278455-9d59-4a75-8663-6a142ac6cebf None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:00.022161 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68278455-9d59-4a75-8663-6a142ac6cebf None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:00.022664 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68278455-9d59-4a75-8663-6a142ac6cebf None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:00.024634 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 359/726] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:54:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 15:54:00.030200 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f63bdc-13e7-480f-b834-c15e7754862f None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:00.031673 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f63bdc-13e7-480f-b834-c15e7754862f None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:00.032174 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f63bdc-13e7-480f-b834-c15e7754862f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:00.059421 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-c8f63bdc-13e7-480f-b834-c15e7754862f None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:54:00.061347 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-c8f63bdc-13e7-480f-b834-c15e7754862f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:54:00.068226 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9743b289-b295-4ef1-9e0a-d142fe1d2e1d None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:00.118206 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859ab91d-92f9-4261-b5b5-b823ccb27833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:00.119539 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ab91d-92f9-4261-b5b5-b823ccb27833 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:00.119951 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ab91d-92f9-4261-b5b5-b823ccb27833 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:00.120343 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ab91d-92f9-4261-b5b5-b823ccb27833 None admin] PATH_INFO: `/v3/projects` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:00.121506 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859ab91d-92f9-4261-b5b5-b823ccb27833 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:54:00.122412 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859ab91d-92f9-4261-b5b5-b823ccb27833 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:00.124934 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859ab91d-92f9-4261-b5b5-b823ccb27833 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:00.145825 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 368/727] 10.222.0.70 () {56 vars in 1148 bytes} [Fri Aug 19 15:53:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:54:00.147323 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859ab91d-92f9-4261-b5b5-b823ccb27833 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:54:00.160903 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 360/728] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:54:00 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:54:00.224250 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:54:00.275423 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859ab91d-92f9-4261-b5b5-b823ccb27833 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:00.321616 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f63bdc-13e7-480f-b834-c15e7754862f None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:54:00.352888 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:54:00.444527 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f63bdc-13e7-480f-b834-c15e7754862f None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:00.459423 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408e920-7672-40ce-940c-450ea98ca8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:00.460472 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408e920-7672-40ce-940c-450ea98ca8f6 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:00.460917 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408e920-7672-40ce-940c-450ea98ca8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:00.461194 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408e920-7672-40ce-940c-450ea98ca8f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:00.462044 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d408e920-7672-40ce-940c-450ea98ca8f6 None admin] RBAC: Adding query filter params (role.id=2f6cb7d6ec874879972a12a63d61068d, scope.project.id=48fb7e21c6864d30b70ffca9093afec8, user.id=d90cec9e3ff64b5aa4cc867895b996ad) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:54:00.462508 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d408e920-7672-40ce-940c-450ea98ca8f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:00.464337 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d408e920-7672-40ce-940c-450ea98ca8f6 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:00.477021 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 369/729] 10.222.0.70 () {56 vars in 1374 bytes} [Fri Aug 19 15:54:00 2022] GET /identity/v3/role_assignments?user.id=d90cec9e3ff64b5aa4cc867895b996ad&scope.project.id=48fb7e21c6864d30b70ffca9093afec8&role.id=2f6cb7d6ec874879972a12a63d61068d => generated 608 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:54:00.488566 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90ee1bc-eb19-4959-be49-75cb1bf76f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:00.489764 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ee1bc-eb19-4959-be49-75cb1bf76f87 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:00.490283 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ee1bc-eb19-4959-be49-75cb1bf76f87 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:00.490760 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ee1bc-eb19-4959-be49-75cb1bf76f87 None admin] PATH_INFO: `/v3/services/image` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:00.491599 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90ee1bc-eb19-4959-be49-75cb1bf76f87 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:00.493286 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90ee1bc-eb19-4959-be49-75cb1bf76f87 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:00.504685 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408e920-7672-40ce-940c-450ea98ca8f6 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:54:00.505059 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-e90ee1bc-eb19-4959-be49-75cb1bf76f87 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 15:54:00.505059 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:54:00.505059 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 15:54:00.505059 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 15:54:00.505059 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 15:54:00.505059 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 15:54:00.505059 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 15:54:00.505059 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:54:00.505059 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 15:54:00.505059 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:54:00.505059 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 15:54:00.505059 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:54:00.505059 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:54:00.505059 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:54:00.505059 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:54:00.505059 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:54:00.505059 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:54:00.505995 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:54:00.505995 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:54:00.505995 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:54:00.505995 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:54:00.505995 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:54:00.505995 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:54:00.505995 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 15:54:00.505995 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 15:54:00.505995 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 15:54:00.505995 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 15:54:00.505995 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:54:00.505995 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:54:00.505995 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:54:00.505995 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:54:00.505995 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:54:00.505995 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:54:00.506901 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:54:00.506901 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:54:00.506901 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:54:00.506901 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:54:00.506901 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:54:00.506901 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:54:00.506901 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:54:00.506901 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:54:00.506901 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:54:00.506901 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:54:00.506901 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 15:54:00.506901 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:54:00.506901 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 15:54:00.506901 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:54:00.506901 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 361/730] 10.222.0.70 () {56 vars in 1105 bytes} [Fri Aug 19 15:54:00 2022] GET /identity/v3/services/image => generated 86 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:54:00.516710 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90ee1bc-eb19-4959-be49-75cb1bf76f87 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:54:00.629071 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:54:00.641596 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90ee1bc-eb19-4959-be49-75cb1bf76f87 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:00.654663 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408e920-7672-40ce-940c-450ea98ca8f6 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:00.691889 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:54:00.710893 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1233d-9b70-4494-9440-fc5a34341896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:00.710893 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1233d-9b70-4494-9440-fc5a34341896 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:00.710893 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1233d-9b70-4494-9440-fc5a34341896 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:00.710893 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1233d-9b70-4494-9440-fc5a34341896 None admin] PATH_INFO: `/v3/services` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:00.711333 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae1233d-9b70-4494-9440-fc5a34341896 None admin] RBAC: Adding query filter params (name=image) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:54:00.711333 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae1233d-9b70-4494-9440-fc5a34341896 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:00.711333 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae1233d-9b70-4494-9440-fc5a34341896 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:00.715655 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 362/731] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:54:00 2022] GET /identity/v3/services?name=image => generated 122 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:54:00.716366 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ccaa8-48f8-4009-b695-442bd2c70cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:00.718713 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ccaa8-48f8-4009-b695-442bd2c70cf7 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:00.718713 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ccaa8-48f8-4009-b695-442bd2c70cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:00.718713 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ccaa8-48f8-4009-b695-442bd2c70cf7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:00.718713 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00ccaa8-48f8-4009-b695-442bd2c70cf7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:00.719499 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00ccaa8-48f8-4009-b695-442bd2c70cf7 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:00.721799 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1233d-9b70-4494-9440-fc5a34341896 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:54:00.733633 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-c00ccaa8-48f8-4009-b695-442bd2c70cf7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 15:54:00.733633 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:54:00.733633 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 15:54:00.733633 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 15:54:00.733633 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 15:54:00.733633 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 15:54:00.733633 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 15:54:00.733633 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:54:00.733633 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 15:54:00.733633 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:54:00.733633 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 15:54:00.733633 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:54:00.733633 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:54:00.733633 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:54:00.733633 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:54:00.733633 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:54:00.733633 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:54:00.734753 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:54:00.734753 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:54:00.734753 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:54:00.734753 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:54:00.734753 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:54:00.734753 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:54:00.734753 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 15:54:00.734753 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 15:54:00.734753 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 15:54:00.734753 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 15:54:00.734753 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:54:00.734753 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:54:00.734753 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:54:00.734753 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:54:00.734753 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:54:00.734753 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:54:00.736254 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:54:00.736254 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:54:00.736254 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:54:00.736254 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:54:00.736254 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:54:00.736254 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:54:00.736254 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:54:00.736254 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:54:00.736254 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:54:00.736254 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:54:00.736254 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 15:54:00.736254 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:54:00.736254 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 15:54:00.736254 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:54:00.740272 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 370/732] 10.222.0.70 () {56 vars in 1129 bytes} [Fri Aug 19 15:54:00 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:54:00.741833 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ccaa8-48f8-4009-b695-442bd2c70cf7 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:54:00.880125 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1233d-9b70-4494-9440-fc5a34341896 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:00.889476 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ccaa8-48f8-4009-b695-442bd2c70cf7 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:00.932997 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2247b6f-54d5-48ce-9076-16276c0445d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:00.933648 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2247b6f-54d5-48ce-9076-16276c0445d7 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:00.933931 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2247b6f-54d5-48ce-9076-16276c0445d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:00.934205 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2247b6f-54d5-48ce-9076-16276c0445d7 None admin] PATH_INFO: `/v3/services` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:00.935206 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2247b6f-54d5-48ce-9076-16276c0445d7 None admin] RBAC: Adding query filter params (type=image) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:54:00.935514 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2247b6f-54d5-48ce-9076-16276c0445d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:00.937310 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2247b6f-54d5-48ce-9076-16276c0445d7 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:00.944059 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 363/733] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:54:00 2022] GET /identity/v3/services?type=image => generated 350 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:54:00.944744 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fe0ca4-c07a-482c-816e-5f800babf936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:00.945712 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe0ca4-c07a-482c-816e-5f800babf936 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:00.946209 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe0ca4-c07a-482c-816e-5f800babf936 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:00.946682 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe0ca4-c07a-482c-816e-5f800babf936 None admin] PATH_INFO: `/v3/services` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:00.947635 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fe0ca4-c07a-482c-816e-5f800babf936 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:54:00.948219 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fe0ca4-c07a-482c-816e-5f800babf936 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:00.950401 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fe0ca4-c07a-482c-816e-5f800babf936 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:00.950664 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2247b6f-54d5-48ce-9076-16276c0445d7 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:54:00.957306 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 371/734] 10.222.0.70 () {56 vars in 1124 bytes} [Fri Aug 19 15:54:00 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:54:00.970022 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fe0ca4-c07a-482c-816e-5f800babf936 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:54:00.975805 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:54:01.036651 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:54:01.108226 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fe0ca4-c07a-482c-816e-5f800babf936 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:01.167908 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb8433-9943-4e24-97b7-49f36f1b56b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:01.168538 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb8433-9943-4e24-97b7-49f36f1b56b3 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:01.168848 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb8433-9943-4e24-97b7-49f36f1b56b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:01.169125 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb8433-9943-4e24-97b7-49f36f1b56b3 None admin] PATH_INFO: `/v3/services` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:01.169839 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb8433-9943-4e24-97b7-49f36f1b56b3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:54:01.170137 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb8433-9943-4e24-97b7-49f36f1b56b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:01.171563 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb8433-9943-4e24-97b7-49f36f1b56b3 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:01.181057 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 372/735] 10.222.0.70 () {56 vars in 1124 bytes} [Fri Aug 19 15:54:00 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:54:01.183252 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c52958-18c4-4d2e-aee6-1342b37e11a7 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:01.183665 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c52958-18c4-4d2e-aee6-1342b37e11a7 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:01.184050 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c52958-18c4-4d2e-aee6-1342b37e11a7 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:01.187852 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 373/736] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:54:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:54:01.187852 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c52958-18c4-4d2e-aee6-1342b37e11a7 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:54:01.226476 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2247b6f-54d5-48ce-9076-16276c0445d7 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:01.264294 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b751e59-4710-45f8-a4c2-485feeb4afe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:01.264910 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b751e59-4710-45f8-a4c2-485feeb4afe3 None admin] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:01.265258 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b751e59-4710-45f8-a4c2-485feeb4afe3 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:01.265511 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b751e59-4710-45f8-a4c2-485feeb4afe3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:01.266126 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b751e59-4710-45f8-a4c2-485feeb4afe3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:01.267473 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b751e59-4710-45f8-a4c2-485feeb4afe3 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:01.308534 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c52958-18c4-4d2e-aee6-1342b37e11a7 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:01.323499 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:54:01.343853 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1bc0dc-3e49-4e85-94aa-62546f953556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:01.344452 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1bc0dc-3e49-4e85-94aa-62546f953556 None admin] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:01.344764 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1bc0dc-3e49-4e85-94aa-62546f953556 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:01.345036 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1bc0dc-3e49-4e85-94aa-62546f953556 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:01.345686 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1bc0dc-3e49-4e85-94aa-62546f953556 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:01.347061 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1bc0dc-3e49-4e85-94aa-62546f953556 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:01.441195 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 364/737] 10.222.0.70 () {60 vars in 1144 bytes} [Fri Aug 19 15:54:00 2022] POST /identity/v3/endpoints => generated 327 bytes in 491 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:54:01.442665 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428a4cc-a0be-4217-ac60-85cefb095229 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:01.442949 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428a4cc-a0be-4217-ac60-85cefb095229 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:01.443214 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428a4cc-a0be-4217-ac60-85cefb095229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:01.463946 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-1428a4cc-a0be-4217-ac60-85cefb095229 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:54:01.467126 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-1428a4cc-a0be-4217-ac60-85cefb095229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:54:01.489993 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 374/738] 10.222.0.70 () {60 vars in 1144 bytes} [Fri Aug 19 15:54:01 2022] POST /identity/v3/endpoints => generated 346 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:54:01.562656 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:54:01.575902 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 365/739] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:54:01 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:54:01.917841 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1bc0dc-3e49-4e85-94aa-62546f953556 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:54:02.026280 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1bc0dc-3e49-4e85-94aa-62546f953556 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:02.063464 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6ff77-5001-4941-905b-6a27550cdca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:02.064512 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6ff77-5001-4941-905b-6a27550cdca5 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:02.065017 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6ff77-5001-4941-905b-6a27550cdca5 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:02.065490 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6ff77-5001-4941-905b-6a27550cdca5 None admin] PATH_INFO: `/v3/services/network` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:02.066293 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c6ff77-5001-4941-905b-6a27550cdca5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:02.067876 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c6ff77-5001-4941-905b-6a27550cdca5 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:02.077272 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-57c6ff77-5001-4941-905b-6a27550cdca5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 15:54:02.077272 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:54:02.077272 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 15:54:02.077272 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 15:54:02.077272 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 15:54:02.077272 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 15:54:02.077272 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 15:54:02.077272 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:54:02.077272 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 15:54:02.077272 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:54:02.077272 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 15:54:02.077272 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:54:02.077272 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:54:02.077272 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:54:02.077272 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:54:02.077272 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:54:02.077272 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:54:02.078305 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:54:02.078305 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:54:02.078305 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:54:02.078305 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:54:02.078305 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:54:02.078305 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:54:02.078305 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 15:54:02.078305 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 15:54:02.078305 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 15:54:02.078305 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 15:54:02.078305 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:54:02.078305 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:54:02.078305 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:54:02.078305 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:54:02.078305 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:54:02.078305 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:54:02.079233 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:54:02.079233 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:54:02.079233 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:54:02.079233 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:54:02.079233 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:54:02.079233 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:54:02.079233 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:54:02.079233 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:54:02.079233 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:54:02.079233 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:54:02.079233 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 15:54:02.079233 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:54:02.079233 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 15:54:02.079233 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:54:02.081992 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 375/740] 10.222.0.70 () {56 vars in 1111 bytes} [Fri Aug 19 15:54:01 2022] GET /identity/v3/services/network => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:54:02.088266 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428a4cc-a0be-4217-ac60-85cefb095229 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:54:02.194885 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428a4cc-a0be-4217-ac60-85cefb095229 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:02.232979 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb2c74-f555-43ca-a675-43bb33073e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:02.234377 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb2c74-f555-43ca-a675-43bb33073e35 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:02.234884 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb2c74-f555-43ca-a675-43bb33073e35 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:02.235367 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb2c74-f555-43ca-a675-43bb33073e35 None admin] PATH_INFO: `/v3/services` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:02.236211 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb2c74-f555-43ca-a675-43bb33073e35 None admin] RBAC: Adding query filter params (name=network) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:54:02.236787 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb2c74-f555-43ca-a675-43bb33073e35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:02.238366 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb2c74-f555-43ca-a675-43bb33073e35 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:02.243869 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 366/741] 10.222.0.70 () {56 vars in 1112 bytes} [Fri Aug 19 15:54:02 2022] GET /identity/v3/services?name=network => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:54:02.249745 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6ff77-5001-4941-905b-6a27550cdca5 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:54:02.293319 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:54:02.355072 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6ff77-5001-4941-905b-6a27550cdca5 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:02.396572 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc1ee5-467f-4a7f-a28d-5b15b7f837c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:02.397217 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc1ee5-467f-4a7f-a28d-5b15b7f837c4 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:02.397529 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc1ee5-467f-4a7f-a28d-5b15b7f837c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:02.397864 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc1ee5-467f-4a7f-a28d-5b15b7f837c4 None admin] PATH_INFO: `/v3/services` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:02.398500 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fc1ee5-467f-4a7f-a28d-5b15b7f837c4 None admin] RBAC: Adding query filter params (type=network) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:54:02.398805 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fc1ee5-467f-4a7f-a28d-5b15b7f837c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:02.400902 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fc1ee5-467f-4a7f-a28d-5b15b7f837c4 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:02.407307 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 376/742] 10.222.0.70 () {56 vars in 1112 bytes} [Fri Aug 19 15:54:02 2022] GET /identity/v3/services?type=network => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:54:02.413418 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb2c74-f555-43ca-a675-43bb33073e35 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:54:02.482698 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:54:02.524817 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb2c74-f555-43ca-a675-43bb33073e35 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:02.562680 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93649713-bb80-486b-b852-989e0ee11e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:02.563304 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93649713-bb80-486b-b852-989e0ee11e4b None admin] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:02.563587 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93649713-bb80-486b-b852-989e0ee11e4b None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:02.563856 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93649713-bb80-486b-b852-989e0ee11e4b None admin] PATH_INFO: `/v3/endpoints` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:02.564530 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93649713-bb80-486b-b852-989e0ee11e4b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:02.565921 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93649713-bb80-486b-b852-989e0ee11e4b None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:02.685404 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 367/743] 10.222.0.70 () {60 vars in 1144 bytes} [Fri Aug 19 15:54:02 2022] POST /identity/v3/endpoints => generated 337 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:54:02.921544 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d9bf2-2c91-4fc6-bdda-3228e34d2f37 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:02.921729 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d9bf2-2c91-4fc6-bdda-3228e34d2f37 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:02.922082 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d9bf2-2c91-4fc6-bdda-3228e34d2f37 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:02.923611 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 377/744] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:54:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:54:02.929438 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e02b31-b279-4015-83e6-32c6db5c54e0 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:02.929713 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e02b31-b279-4015-83e6-32c6db5c54e0 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:02.929994 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e02b31-b279-4015-83e6-32c6db5c54e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:02.949484 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-22e02b31-b279-4015-83e6-32c6db5c54e0 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:54:02.950694 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-22e02b31-b279-4015-83e6-32c6db5c54e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:54:03.036764 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 368/745] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:54:02 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 15:54:03.367311 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d9bf2-2c91-4fc6-bdda-3228e34d2f37 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:54:03.483483 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:54:03.488567 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d9bf2-2c91-4fc6-bdda-3228e34d2f37 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:03.531715 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4034c96-a6e5-401a-8de1-08eeb89bcb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:03.532366 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4034c96-a6e5-401a-8de1-08eeb89bcb07 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:03.532640 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4034c96-a6e5-401a-8de1-08eeb89bcb07 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:03.532940 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4034c96-a6e5-401a-8de1-08eeb89bcb07 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:03.533519 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4034c96-a6e5-401a-8de1-08eeb89bcb07 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:03.534878 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4034c96-a6e5-401a-8de1-08eeb89bcb07 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:03.544195 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-f4034c96-a6e5-401a-8de1-08eeb89bcb07 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 15:54:03.544195 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:54:03.544195 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 15:54:03.544195 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 15:54:03.544195 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 15:54:03.544195 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 15:54:03.544195 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 15:54:03.544195 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:54:03.544195 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 15:54:03.544195 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:54:03.544195 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 15:54:03.544195 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:54:03.544195 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:54:03.544195 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:54:03.544195 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:54:03.544195 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:54:03.545550 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:54:03.545550 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:54:03.545550 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:54:03.545550 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:54:03.545550 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:54:03.545550 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:54:03.545550 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:54:03.545550 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 15:54:03.545550 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 15:54:03.545550 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 15:54:03.545550 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 15:54:03.545550 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:54:03.545550 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:54:03.545550 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:54:03.545550 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:54:03.545550 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:54:03.545550 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:54:03.546428 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:54:03.546428 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:54:03.546428 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:54:03.546428 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:54:03.546428 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:54:03.546428 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:54:03.546428 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:54:03.546428 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:54:03.546428 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:54:03.546428 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:54:03.546428 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 15:54:03.546428 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:54:03.546428 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 15:54:03.546428 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:54:03.548757 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 378/746] 10.222.0.70 () {56 vars in 1132 bytes} [Fri Aug 19 15:54:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:54:03.551716 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e02b31-b279-4015-83e6-32c6db5c54e0 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:54:03.601982 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:54:03.664880 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e02b31-b279-4015-83e6-32c6db5c54e0 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:03.709564 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968da41f-dbe4-4d5f-8646-059a2fba059f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:03.710297 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968da41f-dbe4-4d5f-8646-059a2fba059f None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:03.710571 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968da41f-dbe4-4d5f-8646-059a2fba059f None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:03.710843 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968da41f-dbe4-4d5f-8646-059a2fba059f None admin] PATH_INFO: `/v3/services` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:03.711800 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968da41f-dbe4-4d5f-8646-059a2fba059f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:54:03.712233 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968da41f-dbe4-4d5f-8646-059a2fba059f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:03.713944 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968da41f-dbe4-4d5f-8646-059a2fba059f None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:03.723901 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 369/747] 10.222.0.70 () {56 vars in 1126 bytes} [Fri Aug 19 15:54:03 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:54:03.725507 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4034c96-a6e5-401a-8de1-08eeb89bcb07 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:54:03.795104 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428938a-8379-430d-a02c-85c75221905c None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:03.795439 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428938a-8379-430d-a02c-85c75221905c None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:03.795649 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428938a-8379-430d-a02c-85c75221905c None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:03.797155 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 370/748] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:54:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:54:03.802596 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd4a3cf-a9c1-4595-b1d2-2fa24f745062 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:03.802918 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd4a3cf-a9c1-4595-b1d2-2fa24f745062 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:03.803194 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd4a3cf-a9c1-4595-b1d2-2fa24f745062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:03.823879 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-ccd4a3cf-a9c1-4595-b1d2-2fa24f745062 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:54:03.825107 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-ccd4a3cf-a9c1-4595-b1d2-2fa24f745062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:54:03.851998 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4034c96-a6e5-401a-8de1-08eeb89bcb07 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:03.893211 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829066f9-156d-410c-98bd-d58c6b028c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:03.893211 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829066f9-156d-410c-98bd-d58c6b028c20 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:03.893852 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829066f9-156d-410c-98bd-d58c6b028c20 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:03.893852 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829066f9-156d-410c-98bd-d58c6b028c20 None admin] PATH_INFO: `/v3/services` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:03.894278 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829066f9-156d-410c-98bd-d58c6b028c20 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:54:03.894581 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829066f9-156d-410c-98bd-d58c6b028c20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:03.895945 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829066f9-156d-410c-98bd-d58c6b028c20 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:03.901318 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 379/749] 10.222.0.70 () {56 vars in 1126 bytes} [Fri Aug 19 15:54:03 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:54:03.901967 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 371/750] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:54:03 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 15:54:03.905817 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447c6ec-f9d9-436a-ae40-790c715d3c2c None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:03.906097 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447c6ec-f9d9-436a-ae40-790c715d3c2c None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:03.906367 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447c6ec-f9d9-436a-ae40-790c715d3c2c None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:03.908105 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 380/751] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:54:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:54:03.914029 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a4545-9f14-488e-a46b-5a250e75fa04 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:03.914381 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a4545-9f14-488e-a46b-5a250e75fa04 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:03.914752 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a4545-9f14-488e-a46b-5a250e75fa04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:03.935627 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-609a4545-9f14-488e-a46b-5a250e75fa04 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:54:03.936805 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-609a4545-9f14-488e-a46b-5a250e75fa04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:54:03.974725 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:54:04.020142 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 372/752] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:54:03 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:54:04.237678 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447c6ec-f9d9-436a-ae40-790c715d3c2c None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:54:04.272325 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:54:04.348157 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a4545-9f14-488e-a46b-5a250e75fa04 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:54:04.358270 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447c6ec-f9d9-436a-ae40-790c715d3c2c None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:04.397049 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e188d-64cf-4130-9af5-a7ebb6e8f17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:04.397716 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e188d-64cf-4130-9af5-a7ebb6e8f17b None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:04.398020 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e188d-64cf-4130-9af5-a7ebb6e8f17b None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:04.398198 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e188d-64cf-4130-9af5-a7ebb6e8f17b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:04.475317 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a4545-9f14-488e-a46b-5a250e75fa04 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:04.475878 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8e188d-64cf-4130-9af5-a7ebb6e8f17b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:04.477442 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8e188d-64cf-4130-9af5-a7ebb6e8f17b None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:04.507840 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:54:04.523101 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e82e8-771b-4b62-97c3-0067188326e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:04.523859 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e82e8-771b-4b62-97c3-0067188326e0 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:04.524143 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e82e8-771b-4b62-97c3-0067188326e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:04.524415 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e82e8-771b-4b62-97c3-0067188326e0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:04.525153 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e82e8-771b-4b62-97c3-0067188326e0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:04.526636 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e82e8-771b-4b62-97c3-0067188326e0 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:04.536377 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-b92e82e8-771b-4b62-97c3-0067188326e0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 15:54:04.536377 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:54:04.536377 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 15:54:04.536377 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 15:54:04.536377 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 15:54:04.536377 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 15:54:04.536377 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 15:54:04.536377 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:54:04.536377 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 15:54:04.536377 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:54:04.536377 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 15:54:04.536377 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:54:04.536377 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:54:04.536377 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:54:04.536377 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:54:04.536377 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:54:04.536377 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:54:04.537433 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:54:04.537433 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:54:04.537433 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:54:04.537433 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:54:04.537433 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:54:04.537433 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:54:04.537433 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 15:54:04.537433 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 15:54:04.537433 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 15:54:04.537433 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 15:54:04.537433 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:54:04.537433 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:54:04.537433 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:54:04.537433 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:54:04.537433 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:54:04.537433 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:54:04.538405 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:54:04.538405 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:54:04.538405 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:54:04.538405 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:54:04.538405 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:54:04.538405 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:54:04.538405 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:54:04.538405 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:54:04.538405 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:54:04.538405 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:54:04.538405 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 15:54:04.538405 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:54:04.538405 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 15:54:04.538405 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:54:04.538405 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 373/753] 10.222.0.70 () {56 vars in 1114 bytes} [Fri Aug 19 15:54:04 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:54:04.543377 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e82e8-771b-4b62-97c3-0067188326e0 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:54:04.577848 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:54:04.608440 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 381/754] 10.222.0.70 () {58 vars in 1282 bytes} [Fri Aug 19 15:54:04 2022] GET /identity/v3/auth/tokens => generated 1406 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 15:54:04.613885 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e188d-64cf-4130-9af5-a7ebb6e8f17b None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:54:04.667604 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e82e8-771b-4b62-97c3-0067188326e0 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:04.703071 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d5386-60d7-4b33-856e-37d5272ae293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:04.703672 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d5386-60d7-4b33-856e-37d5272ae293 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:04.703947 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d5386-60d7-4b33-856e-37d5272ae293 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:04.704214 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d5386-60d7-4b33-856e-37d5272ae293 None admin] PATH_INFO: `/v3/services` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:04.704917 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d5386-60d7-4b33-856e-37d5272ae293 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:54:04.705222 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d5386-60d7-4b33-856e-37d5272ae293 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:04.706569 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d5386-60d7-4b33-856e-37d5272ae293 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:04.711215 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 374/755] 10.222.0.70 () {56 vars in 1114 bytes} [Fri Aug 19 15:54:04 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:54:04.717298 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d5386-60d7-4b33-856e-37d5272ae293 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:54:04.736473 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e188d-64cf-4130-9af5-a7ebb6e8f17b None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:04.768317 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:54:04.777629 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c0f1fe-94f1-41a7-a64a-a7055b60134c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:04.786603 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0f1fe-94f1-41a7-a64a-a7055b60134c None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:04.786603 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0f1fe-94f1-41a7-a64a-a7055b60134c None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:04.786603 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0f1fe-94f1-41a7-a64a-a7055b60134c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:04.788967 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c0f1fe-94f1-41a7-a64a-a7055b60134c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:04.790902 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c0f1fe-94f1-41a7-a64a-a7055b60134c None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:04.806870 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-63c0f1fe-94f1-41a7-a64a-a7055b60134c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:54:04.806870 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:54:04.806870 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:54:04.806870 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:54:04.806870 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:54:04.806870 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:54:04.806870 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:54:04.806870 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:54:04.806870 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:54:04.806870 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:54:04.806870 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:54:04.806870 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:54:04.806870 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:54:04.806870 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:54:04.806870 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:54:04.806870 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:54:04.808098 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:54:04.808098 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:54:04.808098 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:54:04.808098 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:54:04.808098 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:54:04.808098 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:54:04.808098 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:54:04.808098 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:54:04.808098 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:54:04.808098 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:54:04.808098 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:54:04.808098 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:54:04.808098 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:54:04.808098 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:54:04.808098 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:54:04.808098 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:54:04.808098 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:54:04.809052 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:54:04.809052 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:54:04.809052 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:54:04.809052 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 382/756] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:54:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:54:04.814034 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c0f1fe-94f1-41a7-a64a-a7055b60134c None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:54:04.825036 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:54:04.831597 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d5386-60d7-4b33-856e-37d5272ae293 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:04.867718 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19080efa-5f20-428f-85be-2140f8155a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:04.868323 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19080efa-5f20-428f-85be-2140f8155a21 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:04.868689 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19080efa-5f20-428f-85be-2140f8155a21 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:04.869491 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19080efa-5f20-428f-85be-2140f8155a21 None admin] PATH_INFO: `/v3/services` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:04.870138 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19080efa-5f20-428f-85be-2140f8155a21 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:54:04.870464 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19080efa-5f20-428f-85be-2140f8155a21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:04.871860 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19080efa-5f20-428f-85be-2140f8155a21 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:04.876742 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 375/757] 10.222.0.70 () {56 vars in 1114 bytes} [Fri Aug 19 15:54:04 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:54:04.930987 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c0f1fe-94f1-41a7-a64a-a7055b60134c None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:04.971909 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ffaeea-76ec-4f9c-b619-d7022339c915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:04.972556 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ffaeea-76ec-4f9c-b619-d7022339c915 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:04.972868 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ffaeea-76ec-4f9c-b619-d7022339c915 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:04.973142 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ffaeea-76ec-4f9c-b619-d7022339c915 None admin] PATH_INFO: `/v3/domains` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:04.973809 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ffaeea-76ec-4f9c-b619-d7022339c915 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:54:04.974110 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ffaeea-76ec-4f9c-b619-d7022339c915 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:04.975726 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ffaeea-76ec-4f9c-b619-d7022339c915 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:04.990822 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 383/758] 10.222.0.70 () {56 vars in 1109 bytes} [Fri Aug 19 15:54:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:54:06.157416 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b15737-893d-4e99-8630-53fec0a60cf4 None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:06.157989 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b15737-893d-4e99-8630-53fec0a60cf4 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:06.157989 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b15737-893d-4e99-8630-53fec0a60cf4 None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:06.159587 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 376/759] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:54:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:54:06.165057 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a8576-bc8d-45b9-b542-72bb40535c21 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:06.165625 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a8576-bc8d-45b9-b542-72bb40535c21 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:06.165625 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a8576-bc8d-45b9-b542-72bb40535c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:06.185015 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-8b6a8576-bc8d-45b9-b542-72bb40535c21 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:54:06.186217 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-8b6a8576-bc8d-45b9-b542-72bb40535c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:54:06.216529 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:54:06.254886 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 384/760] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:54:06 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:54:06.582607 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b15737-893d-4e99-8630-53fec0a60cf4 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:54:06.693053 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b15737-893d-4e99-8630-53fec0a60cf4 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:06.727810 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be2511-1448-4549-81d9-c4f12ddab922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:06.728582 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be2511-1448-4549-81d9-c4f12ddab922 None admin] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:06.728883 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be2511-1448-4549-81d9-c4f12ddab922 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:06.729155 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be2511-1448-4549-81d9-c4f12ddab922 None admin] PATH_INFO: `/v3/services` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:06.729802 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69be2511-1448-4549-81d9-c4f12ddab922 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:06.731160 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69be2511-1448-4549-81d9-c4f12ddab922 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:06.808373 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 377/761] 10.222.0.70 () {60 vars in 1141 bytes} [Fri Aug 19 15:54:06 2022] POST /identity/v3/services => generated 269 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:54:07.139062 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e26a78-2c17-410f-b23a-d955e42f0abc None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:07.139338 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e26a78-2c17-410f-b23a-d955e42f0abc None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:07.139606 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e26a78-2c17-410f-b23a-d955e42f0abc None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:07.141122 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 385/762] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:54:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:54:07.146402 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd15a5f-37a4-42ac-ad9a-118203c85ec8 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:07.146685 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd15a5f-37a4-42ac-ad9a-118203c85ec8 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:07.146959 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd15a5f-37a4-42ac-ad9a-118203c85ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:07.167406 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-dbd15a5f-37a4-42ac-ad9a-118203c85ec8 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:54:07.168600 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-dbd15a5f-37a4-42ac-ad9a-118203c85ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:54:07.187856 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:54:07.251820 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 378/763] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:54:07 2022] POST /identity/v3/auth/tokens => generated 1516 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:54:07.585391 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e26a78-2c17-410f-b23a-d955e42f0abc None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:54:07.694349 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e26a78-2c17-410f-b23a-d955e42f0abc None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:07.728582 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac638a-7d5f-423a-8eb1-364770f70796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:07.729201 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac638a-7d5f-423a-8eb1-364770f70796 None admin] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:07.729478 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac638a-7d5f-423a-8eb1-364770f70796 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:07.729748 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac638a-7d5f-423a-8eb1-364770f70796 None admin] PATH_INFO: `/v3/services` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:07.730388 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fac638a-7d5f-423a-8eb1-364770f70796 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:07.731742 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fac638a-7d5f-423a-8eb1-364770f70796 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:07.870786 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 386/764] 10.222.0.70 () {60 vars in 1141 bytes} [Fri Aug 19 15:54:07 2022] POST /identity/v3/services => generated 251 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:54:09.055176 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e90ed-1dd0-45cc-a414-2eb554cb8a22 None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:09.055712 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e90ed-1dd0-45cc-a414-2eb554cb8a22 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:09.055712 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e90ed-1dd0-45cc-a414-2eb554cb8a22 None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:09.057616 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 379/765] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:54:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:54:09.063075 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107e305-8198-41d4-98b9-fc6b9358e9d5 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:09.063599 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107e305-8198-41d4-98b9-fc6b9358e9d5 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:09.063779 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107e305-8198-41d4-98b9-fc6b9358e9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:09.082857 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-c107e305-8198-41d4-98b9-fc6b9358e9d5 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:54:09.084062 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-c107e305-8198-41d4-98b9-fc6b9358e9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:54:09.109288 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:54:09.162822 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 387/766] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:54:09 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:54:09.511067 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e90ed-1dd0-45cc-a414-2eb554cb8a22 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:54:09.618838 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e90ed-1dd0-45cc-a414-2eb554cb8a22 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:09.656906 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db9a30-ad3b-469f-ad4b-5f4209726459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:09.657548 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db9a30-ad3b-469f-ad4b-5f4209726459 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:09.657825 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db9a30-ad3b-469f-ad4b-5f4209726459 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:09.658095 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db9a30-ad3b-469f-ad4b-5f4209726459 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:09.658685 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62db9a30-ad3b-469f-ad4b-5f4209726459 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:09.660074 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62db9a30-ad3b-469f-ad4b-5f4209726459 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:09.669991 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-62db9a30-ad3b-469f-ad4b-5f4209726459 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 15:54:09.669991 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:54:09.669991 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 15:54:09.669991 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 15:54:09.669991 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 15:54:09.669991 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 15:54:09.669991 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 15:54:09.669991 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:54:09.669991 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 15:54:09.669991 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:54:09.669991 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 15:54:09.669991 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:54:09.669991 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:54:09.669991 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:54:09.669991 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:54:09.669991 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:54:09.671101 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:54:09.671101 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:54:09.671101 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:54:09.671101 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:54:09.671101 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:54:09.671101 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:54:09.671101 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:54:09.671101 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 15:54:09.671101 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 15:54:09.671101 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 15:54:09.671101 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 15:54:09.671101 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:54:09.671101 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:54:09.671101 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:54:09.671101 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:54:09.671101 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:54:09.671101 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:54:09.672013 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:54:09.672013 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:54:09.672013 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:54:09.672013 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:54:09.672013 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:54:09.672013 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:54:09.672013 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:54:09.672013 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:54:09.672013 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:54:09.672013 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:54:09.672013 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 15:54:09.672013 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:54:09.672013 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 15:54:09.672013 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:54:09.672013 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 380/767] 10.222.0.70 () {56 vars in 1132 bytes} [Fri Aug 19 15:54:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:54:09.677170 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c107e305-8198-41d4-98b9-fc6b9358e9d5 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:54:09.798673 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c107e305-8198-41d4-98b9-fc6b9358e9d5 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:09.847468 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9cd700-c3e6-467a-8955-bbf3847eb2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:09.848096 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cd700-c3e6-467a-8955-bbf3847eb2c6 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:09.856092 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cd700-c3e6-467a-8955-bbf3847eb2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:09.856092 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cd700-c3e6-467a-8955-bbf3847eb2c6 None admin] PATH_INFO: `/v3/services` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:09.856092 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9cd700-c3e6-467a-8955-bbf3847eb2c6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:54:09.856092 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9cd700-c3e6-467a-8955-bbf3847eb2c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:09.856092 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9cd700-c3e6-467a-8955-bbf3847eb2c6 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:09.860051 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 388/768] 10.222.0.70 () {56 vars in 1126 bytes} [Fri Aug 19 15:54:09 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:54:09.866083 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db9a30-ad3b-469f-ad4b-5f4209726459 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:54:09.881400 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:54:09.998476 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db9a30-ad3b-469f-ad4b-5f4209726459 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:10.041100 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc85689-1ef1-45dc-b461-ab2b66fc3454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:10.041859 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc85689-1ef1-45dc-b461-ab2b66fc3454 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:10.042140 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc85689-1ef1-45dc-b461-ab2b66fc3454 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:10.042411 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc85689-1ef1-45dc-b461-ab2b66fc3454 None admin] PATH_INFO: `/v3/services` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:10.043403 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc85689-1ef1-45dc-b461-ab2b66fc3454 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:54:10.043708 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc85689-1ef1-45dc-b461-ab2b66fc3454 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:10.045118 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc85689-1ef1-45dc-b461-ab2b66fc3454 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:10.050704 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 381/769] 10.222.0.70 () {56 vars in 1126 bytes} [Fri Aug 19 15:54:09 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:54:10.057859 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9cd700-c3e6-467a-8955-bbf3847eb2c6 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:54:10.080027 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:54:10.144751 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43747cb-31d6-4e53-bd74-fd9dbbae0bfd None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:10.145265 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43747cb-31d6-4e53-bd74-fd9dbbae0bfd None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:10.145265 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43747cb-31d6-4e53-bd74-fd9dbbae0bfd None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:10.146482 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 382/770] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:54:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 15:54:10.152248 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac94dd-0317-4049-abe8-6405f0c981e2 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:10.152532 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac94dd-0317-4049-abe8-6405f0c981e2 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:10.152857 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac94dd-0317-4049-abe8-6405f0c981e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:10.171994 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-f6ac94dd-0317-4049-abe8-6405f0c981e2 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:54:10.173239 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-f6ac94dd-0317-4049-abe8-6405f0c981e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:54:10.183227 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9cd700-c3e6-467a-8955-bbf3847eb2c6 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:10.225208 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb0e1da-f904-4e07-9b95-f066fcc8aa5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:10.225802 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb0e1da-f904-4e07-9b95-f066fcc8aa5b None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:10.226074 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb0e1da-f904-4e07-9b95-f066fcc8aa5b None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:10.226520 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb0e1da-f904-4e07-9b95-f066fcc8aa5b None admin] PATH_INFO: `/v3/endpoints` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:10.227339 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb0e1da-f904-4e07-9b95-f066fcc8aa5b None admin] RBAC: Adding query filter params (interface=public, service_id=efd21d8b7c1449e39eccbd44bd9a54ba, region_id=RegionOne) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:54:10.227638 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb0e1da-f904-4e07-9b95-f066fcc8aa5b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:10.229561 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb0e1da-f904-4e07-9b95-f066fcc8aa5b None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:10.235102 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 389/771] 10.222.0.70 () {56 vars in 1251 bytes} [Fri Aug 19 15:54:10 2022] GET /identity/v3/endpoints?service_id=efd21d8b7c1449e39eccbd44bd9a54ba&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:54:10.240995 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb0e1da-f904-4e07-9b95-f066fcc8aa5b None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:54:10.251835 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 383/772] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:54:10 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 15:54:10.334704 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:54:10.361038 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb0e1da-f904-4e07-9b95-f066fcc8aa5b None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:10.401151 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f842dee6-3bbc-441c-906f-b549a07ef9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:10.401686 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842dee6-3bbc-441c-906f-b549a07ef9a1 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:10.401962 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842dee6-3bbc-441c-906f-b549a07ef9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:10.402230 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842dee6-3bbc-441c-906f-b549a07ef9a1 None admin] PATH_INFO: `/v3/services` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:10.402838 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f842dee6-3bbc-441c-906f-b549a07ef9a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:10.404206 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f842dee6-3bbc-441c-906f-b549a07ef9a1 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:10.410709 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 390/773] 10.222.0.70 () {56 vars in 1087 bytes} [Fri Aug 19 15:54:10 2022] GET /identity/v3/services => generated 1498 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 15:54:10.608005 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac94dd-0317-4049-abe8-6405f0c981e2 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:54:10.611175 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:54:10.708172 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac94dd-0317-4049-abe8-6405f0c981e2 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:10.743148 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0967caa6-2927-4186-9887-393fe3243f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:10.744474 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967caa6-2927-4186-9887-393fe3243f2b None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:10.744786 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967caa6-2927-4186-9887-393fe3243f2b None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:10.745071 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967caa6-2927-4186-9887-393fe3243f2b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:10.745656 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0967caa6-2927-4186-9887-393fe3243f2b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:10.747015 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0967caa6-2927-4186-9887-393fe3243f2b None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:10.755927 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-0967caa6-2927-4186-9887-393fe3243f2b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 15:54:10.755927 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:54:10.755927 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 15:54:10.755927 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 15:54:10.755927 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 15:54:10.755927 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 15:54:10.755927 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 15:54:10.755927 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:54:10.755927 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 15:54:10.755927 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:54:10.755927 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 15:54:10.755927 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:54:10.755927 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:54:10.755927 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:54:10.755927 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:54:10.755927 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:54:10.755927 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:54:10.756989 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:54:10.756989 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:54:10.756989 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:54:10.756989 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:54:10.756989 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:54:10.756989 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:54:10.756989 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 15:54:10.756989 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 15:54:10.756989 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 15:54:10.756989 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 15:54:10.756989 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:54:10.756989 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:54:10.756989 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:54:10.756989 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:54:10.756989 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:54:10.756989 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:54:10.757831 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:54:10.757831 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:54:10.757831 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:54:10.757831 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:54:10.757831 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:54:10.757831 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:54:10.757831 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:54:10.757831 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:54:10.757831 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:54:10.757831 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:54:10.757831 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 15:54:10.757831 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:54:10.757831 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 15:54:10.757831 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:54:10.757831 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 384/774] 10.222.0.70 () {56 vars in 1114 bytes} [Fri Aug 19 15:54:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:54:10.764041 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f842dee6-3bbc-441c-906f-b549a07ef9a1 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:54:10.864088 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f842dee6-3bbc-441c-906f-b549a07ef9a1 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:10.898390 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b9fc0c-bdff-4838-a153-1d5eac75b99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:10.898989 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b9fc0c-bdff-4838-a153-1d5eac75b99a None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:10.899291 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b9fc0c-bdff-4838-a153-1d5eac75b99a None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:10.899557 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b9fc0c-bdff-4838-a153-1d5eac75b99a None admin] PATH_INFO: `/v3/services` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:10.900249 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b9fc0c-bdff-4838-a153-1d5eac75b99a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:54:10.900548 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b9fc0c-bdff-4838-a153-1d5eac75b99a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:10.901928 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b9fc0c-bdff-4838-a153-1d5eac75b99a None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:10.906571 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 391/775] 10.222.0.70 () {56 vars in 1114 bytes} [Fri Aug 19 15:54:10 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:54:10.912975 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0967caa6-2927-4186-9887-393fe3243f2b None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:54:10.980962 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:54:11.015272 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0967caa6-2927-4186-9887-393fe3243f2b None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:11.049643 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e0ed3-6610-4812-b53d-2fd8ad9c116f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:11.050261 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e0ed3-6610-4812-b53d-2fd8ad9c116f None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:11.050546 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e0ed3-6610-4812-b53d-2fd8ad9c116f None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:11.050817 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e0ed3-6610-4812-b53d-2fd8ad9c116f None admin] PATH_INFO: `/v3/services` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:11.051452 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429e0ed3-6610-4812-b53d-2fd8ad9c116f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:54:11.051755 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429e0ed3-6610-4812-b53d-2fd8ad9c116f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:11.053167 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429e0ed3-6610-4812-b53d-2fd8ad9c116f None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:11.060090 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 385/776] 10.222.0.70 () {56 vars in 1114 bytes} [Fri Aug 19 15:54:10 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:54:11.066085 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b9fc0c-bdff-4838-a153-1d5eac75b99a None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:54:11.080898 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:54:11.186026 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b9fc0c-bdff-4838-a153-1d5eac75b99a None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:11.220532 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec02a8-58e1-4d57-865f-0f4c1b3fd834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:11.221462 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec02a8-58e1-4d57-865f-0f4c1b3fd834 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:11.221752 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec02a8-58e1-4d57-865f-0f4c1b3fd834 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:11.222022 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec02a8-58e1-4d57-865f-0f4c1b3fd834 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:11.222740 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ec02a8-58e1-4d57-865f-0f4c1b3fd834 None admin] RBAC: Adding query filter params (interface=public, service_id=f5ffb3619de244b4895d81e0bbb15f7f, region_id=RegionOne) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:54:11.223044 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ec02a8-58e1-4d57-865f-0f4c1b3fd834 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:11.224414 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ec02a8-58e1-4d57-865f-0f4c1b3fd834 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:11.230386 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 392/777] 10.222.0.70 () {56 vars in 1251 bytes} [Fri Aug 19 15:54:11 2022] GET /identity/v3/endpoints?service_id=f5ffb3619de244b4895d81e0bbb15f7f&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:54:11.236164 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e0ed3-6610-4812-b53d-2fd8ad9c116f None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:54:11.343089 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e0ed3-6610-4812-b53d-2fd8ad9c116f None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:11.376706 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:54:11.382005 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40593c94-784d-45a5-b6e0-332b006a4978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:11.382613 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40593c94-784d-45a5-b6e0-332b006a4978 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:11.382894 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40593c94-784d-45a5-b6e0-332b006a4978 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:11.383204 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40593c94-784d-45a5-b6e0-332b006a4978 None admin] PATH_INFO: `/v3/services` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:11.383846 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40593c94-784d-45a5-b6e0-332b006a4978 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:11.385330 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40593c94-784d-45a5-b6e0-332b006a4978 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:11.392916 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 386/778] 10.222.0.70 () {56 vars in 1087 bytes} [Fri Aug 19 15:54:11 2022] GET /identity/v3/services => generated 1498 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:54:12.662035 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb3352-b70e-437d-a9f0-4181ebcd291d None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:12.662537 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb3352-b70e-437d-a9f0-4181ebcd291d None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:12.662537 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb3352-b70e-437d-a9f0-4181ebcd291d None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:12.663792 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 393/779] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:54:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:54:12.669491 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbdfa8-6586-4a55-b42f-996c8d947ed3 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:12.669970 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbdfa8-6586-4a55-b42f-996c8d947ed3 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:12.670062 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbdfa8-6586-4a55-b42f-996c8d947ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:12.689119 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-84bbdfa8-6586-4a55-b42f-996c8d947ed3 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:54:12.690291 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-84bbdfa8-6586-4a55-b42f-996c8d947ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:54:12.758087 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 387/780] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:54:12 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:54:13.084098 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb3352-b70e-437d-a9f0-4181ebcd291d None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:54:13.162140 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:54:13.188078 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb3352-b70e-437d-a9f0-4181ebcd291d None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:13.225955 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cbb2bd-54f3-4173-812d-20956e3b2fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:13.226578 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cbb2bd-54f3-4173-812d-20956e3b2fbe None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:13.226848 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cbb2bd-54f3-4173-812d-20956e3b2fbe None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:13.227115 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cbb2bd-54f3-4173-812d-20956e3b2fbe None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:13.227685 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cbb2bd-54f3-4173-812d-20956e3b2fbe None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:13.229072 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cbb2bd-54f3-4173-812d-20956e3b2fbe None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:13.237574 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-a5cbb2bd-54f3-4173-812d-20956e3b2fbe None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 15:54:13.237574 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:54:13.237574 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 15:54:13.237574 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 15:54:13.237574 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 15:54:13.237574 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 15:54:13.237574 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 15:54:13.237574 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:54:13.237574 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 15:54:13.237574 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:54:13.237574 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 15:54:13.237574 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:54:13.237574 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:54:13.237574 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:54:13.237574 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:54:13.237574 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:54:13.239625 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:54:13.239625 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:54:13.239625 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:54:13.239625 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:54:13.239625 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:54:13.239625 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:54:13.239625 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:54:13.239625 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 15:54:13.239625 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 15:54:13.239625 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 15:54:13.239625 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 15:54:13.239625 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:54:13.239625 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:54:13.239625 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:54:13.239625 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:54:13.239625 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:54:13.239625 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:54:13.241524 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:54:13.241524 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:54:13.241524 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:54:13.241524 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:54:13.241524 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:54:13.241524 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:54:13.241524 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:54:13.241524 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:54:13.241524 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:54:13.241524 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:54:13.241524 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 15:54:13.241524 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:54:13.241524 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 15:54:13.241524 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:54:13.241524 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 394/781] 10.222.0.70 () {56 vars in 1132 bytes} [Fri Aug 19 15:54:13 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:54:13.245312 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bbdfa8-6586-4a55-b42f-996c8d947ed3 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:54:13.348737 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bbdfa8-6586-4a55-b42f-996c8d947ed3 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:13.375942 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:54:13.386735 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8325f203-45b9-464d-86bd-0011099f79a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:13.387349 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8325f203-45b9-464d-86bd-0011099f79a1 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:13.387626 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8325f203-45b9-464d-86bd-0011099f79a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:13.400900 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8325f203-45b9-464d-86bd-0011099f79a1 None admin] PATH_INFO: `/v3/services` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:13.400900 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8325f203-45b9-464d-86bd-0011099f79a1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:54:13.400900 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8325f203-45b9-464d-86bd-0011099f79a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:13.400900 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8325f203-45b9-464d-86bd-0011099f79a1 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:13.400900 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 388/782] 10.222.0.70 () {56 vars in 1126 bytes} [Fri Aug 19 15:54:13 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:54:13.403146 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cbb2bd-54f3-4173-812d-20956e3b2fbe None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:54:13.511840 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cbb2bd-54f3-4173-812d-20956e3b2fbe None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:13.546284 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a86a60-18d4-4bd4-8667-e61ee75a3584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:13.546884 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a86a60-18d4-4bd4-8667-e61ee75a3584 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:13.547155 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a86a60-18d4-4bd4-8667-e61ee75a3584 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:13.547421 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a86a60-18d4-4bd4-8667-e61ee75a3584 None admin] PATH_INFO: `/v3/services` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:13.548044 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a86a60-18d4-4bd4-8667-e61ee75a3584 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:54:13.548338 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a86a60-18d4-4bd4-8667-e61ee75a3584 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:13.549744 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a86a60-18d4-4bd4-8667-e61ee75a3584 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:13.554744 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 395/783] 10.222.0.70 () {56 vars in 1126 bytes} [Fri Aug 19 15:54:13 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:54:13.561440 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8325f203-45b9-464d-86bd-0011099f79a1 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:54:13.658870 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b8546-830d-4035-accd-1269791b8d2a None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:13.659072 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b8546-830d-4035-accd-1269791b8d2a None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:13.659326 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b8546-830d-4035-accd-1269791b8d2a None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:13.660656 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 396/784] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:54:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 15:54:13.666096 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5d2f9-72a3-4f2b-9579-660d3e102723 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:13.666795 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5d2f9-72a3-4f2b-9579-660d3e102723 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:13.666795 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5d2f9-72a3-4f2b-9579-660d3e102723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:13.666969 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8325f203-45b9-464d-86bd-0011099f79a1 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:13.673326 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:54:13.686171 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-42d5d2f9-72a3-4f2b-9579-660d3e102723 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:54:13.693435 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-42d5d2f9-72a3-4f2b-9579-660d3e102723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:54:13.704199 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187dda52-c81e-4174-b842-8fef7a61b3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:13.704849 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187dda52-c81e-4174-b842-8fef7a61b3e0 None admin] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:13.705127 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187dda52-c81e-4174-b842-8fef7a61b3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:13.705397 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187dda52-c81e-4174-b842-8fef7a61b3e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:13.706070 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187dda52-c81e-4174-b842-8fef7a61b3e0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:13.707425 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187dda52-c81e-4174-b842-8fef7a61b3e0 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:13.762178 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 397/785] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:54:13 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 15:54:13.866606 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 389/786] 10.222.0.70 () {60 vars in 1144 bytes} [Fri Aug 19 15:54:13 2022] POST /identity/v3/endpoints => generated 347 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:54:14.102750 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d5d2f9-72a3-4f2b-9579-660d3e102723 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:54:14.209524 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d5d2f9-72a3-4f2b-9579-660d3e102723 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:14.240802 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:54:14.253218 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44225f91-70ce-4313-960d-fbcea3674375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:14.253850 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44225f91-70ce-4313-960d-fbcea3674375 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:14.254146 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44225f91-70ce-4313-960d-fbcea3674375 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:14.254412 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44225f91-70ce-4313-960d-fbcea3674375 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:14.254988 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44225f91-70ce-4313-960d-fbcea3674375 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:14.256349 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44225f91-70ce-4313-960d-fbcea3674375 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:14.266027 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-44225f91-70ce-4313-960d-fbcea3674375 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 15:54:14.266027 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:54:14.266027 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 15:54:14.266027 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 15:54:14.266027 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 15:54:14.266027 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 15:54:14.266027 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 15:54:14.266027 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:54:14.266027 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 15:54:14.266027 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:54:14.266027 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 15:54:14.266027 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:54:14.266027 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:54:14.266027 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:54:14.266027 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:54:14.266027 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:54:14.266027 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:54:14.267092 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:54:14.267092 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:54:14.267092 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:54:14.267092 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:54:14.267092 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:54:14.267092 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:54:14.267092 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 15:54:14.267092 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 15:54:14.267092 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 15:54:14.267092 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 15:54:14.267092 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:54:14.267092 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:54:14.267092 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:54:14.267092 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:54:14.267092 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:54:14.267092 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:54:14.268276 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:54:14.268276 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:54:14.268276 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:54:14.268276 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:54:14.268276 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:54:14.268276 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:54:14.268276 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:54:14.268276 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:54:14.268276 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:54:14.268276 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:54:14.268276 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 15:54:14.268276 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:54:14.268276 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 15:54:14.268276 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:54:14.268276 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 398/787] 10.222.0.70 () {56 vars in 1114 bytes} [Fri Aug 19 15:54:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:54:14.273853 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187dda52-c81e-4174-b842-8fef7a61b3e0 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:54:14.325974 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:54:14.383422 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187dda52-c81e-4174-b842-8fef7a61b3e0 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:14.421147 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226940c6-a538-4493-a7e0-3b09c853b8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:14.421765 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226940c6-a538-4493-a7e0-3b09c853b8ed None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:14.422041 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226940c6-a538-4493-a7e0-3b09c853b8ed None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:14.422310 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226940c6-a538-4493-a7e0-3b09c853b8ed None admin] PATH_INFO: `/v3/services` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:14.422943 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226940c6-a538-4493-a7e0-3b09c853b8ed None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:54:14.423242 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226940c6-a538-4493-a7e0-3b09c853b8ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:14.424617 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226940c6-a538-4493-a7e0-3b09c853b8ed None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:14.429518 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 390/788] 10.222.0.70 () {56 vars in 1114 bytes} [Fri Aug 19 15:54:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:54:14.436020 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44225f91-70ce-4313-960d-fbcea3674375 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:54:14.542971 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44225f91-70ce-4313-960d-fbcea3674375 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:14.585143 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b7f53-ae7d-4857-9b33-42e24941f04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:14.585749 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b7f53-ae7d-4857-9b33-42e24941f04b None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:14.586019 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b7f53-ae7d-4857-9b33-42e24941f04b None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:14.586284 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b7f53-ae7d-4857-9b33-42e24941f04b None admin] PATH_INFO: `/v3/services` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:14.586904 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b7f53-ae7d-4857-9b33-42e24941f04b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:54:14.587852 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b7f53-ae7d-4857-9b33-42e24941f04b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:14.589647 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b7f53-ae7d-4857-9b33-42e24941f04b None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:14.596872 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 399/789] 10.222.0.70 () {56 vars in 1114 bytes} [Fri Aug 19 15:54:14 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:54:14.602970 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226940c6-a538-4493-a7e0-3b09c853b8ed None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:54:14.705638 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226940c6-a538-4493-a7e0-3b09c853b8ed None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:14.716899 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:54:14.741195 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2251cd5b-2e28-4d01-bab0-903862b62a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:14.741803 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251cd5b-2e28-4d01-bab0-903862b62a91 None admin] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:14.742078 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251cd5b-2e28-4d01-bab0-903862b62a91 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:14.742347 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251cd5b-2e28-4d01-bab0-903862b62a91 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:14.743010 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2251cd5b-2e28-4d01-bab0-903862b62a91 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:14.744972 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2251cd5b-2e28-4d01-bab0-903862b62a91 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:14.844220 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 391/790] 10.222.0.70 () {60 vars in 1144 bytes} [Fri Aug 19 15:54:14 2022] POST /identity/v3/endpoints => generated 346 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:54:16.145639 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0092a-b9f8-4d02-84c6-fe57e4a61ffe None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:16.146193 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0092a-b9f8-4d02-84c6-fe57e4a61ffe None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:16.146193 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0092a-b9f8-4d02-84c6-fe57e4a61ffe None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:16.147531 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 400/791] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:54:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:54:16.153200 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314535c7-b8fb-4f5e-a344-e37cf3737602 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:16.153620 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314535c7-b8fb-4f5e-a344-e37cf3737602 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:16.153755 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314535c7-b8fb-4f5e-a344-e37cf3737602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:16.173577 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-314535c7-b8fb-4f5e-a344-e37cf3737602 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:54:16.174800 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-314535c7-b8fb-4f5e-a344-e37cf3737602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:54:16.254269 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 392/792] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:54:16 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:54:16.595811 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb0092a-b9f8-4d02-84c6-fe57e4a61ffe None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:54:16.661494 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:54:16.711112 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb0092a-b9f8-4d02-84c6-fe57e4a61ffe None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:16.744903 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc79da-2c88-49a7-96b3-6196717bdce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:16.745528 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc79da-2c88-49a7-96b3-6196717bdce9 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:16.745802 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc79da-2c88-49a7-96b3-6196717bdce9 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:16.746071 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc79da-2c88-49a7-96b3-6196717bdce9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:16.746637 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc79da-2c88-49a7-96b3-6196717bdce9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:16.747998 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc79da-2c88-49a7-96b3-6196717bdce9 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:16.757100 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-c0dc79da-2c88-49a7-96b3-6196717bdce9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 15:54:16.757100 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:54:16.757100 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 15:54:16.757100 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 15:54:16.757100 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 15:54:16.757100 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 15:54:16.757100 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 15:54:16.757100 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:54:16.757100 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 15:54:16.757100 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:54:16.757100 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 15:54:16.757100 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:54:16.757100 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:54:16.757100 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:54:16.757100 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:54:16.757100 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:54:16.757100 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:54:16.758132 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:54:16.758132 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:54:16.758132 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:54:16.758132 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:54:16.758132 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:54:16.758132 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:54:16.758132 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 15:54:16.758132 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 15:54:16.758132 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 15:54:16.758132 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 15:54:16.758132 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:54:16.758132 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:54:16.758132 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:54:16.758132 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:54:16.758132 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:54:16.758132 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:54:16.758953 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:54:16.758953 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:54:16.758953 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:54:16.758953 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:54:16.758953 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:54:16.758953 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:54:16.758953 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:54:16.758953 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:54:16.758953 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:54:16.758953 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:54:16.758953 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 15:54:16.758953 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:54:16.758953 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 15:54:16.758953 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:54:16.766968 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 401/793] 10.222.0.70 () {56 vars in 1111 bytes} [Fri Aug 19 15:54:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:54:16.767128 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314535c7-b8fb-4f5e-a344-e37cf3737602 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:54:16.858440 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:54:16.866896 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314535c7-b8fb-4f5e-a344-e37cf3737602 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:16.902697 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2121937c-9e75-424d-aaf0-cd144d457382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:16.912076 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121937c-9e75-424d-aaf0-cd144d457382 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:16.912076 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121937c-9e75-424d-aaf0-cd144d457382 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:16.912076 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121937c-9e75-424d-aaf0-cd144d457382 None admin] PATH_INFO: `/v3/services` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:16.912076 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2121937c-9e75-424d-aaf0-cd144d457382 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:54:16.912076 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2121937c-9e75-424d-aaf0-cd144d457382 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:16.912076 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2121937c-9e75-424d-aaf0-cd144d457382 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:16.912928 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 393/794] 10.222.0.70 () {56 vars in 1112 bytes} [Fri Aug 19 15:54:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:54:16.918476 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc79da-2c88-49a7-96b3-6196717bdce9 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:54:17.025165 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc79da-2c88-49a7-96b3-6196717bdce9 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:17.048513 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:54:17.062630 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109c34d-2473-4015-9f23-9af3d694a645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:17.064028 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109c34d-2473-4015-9f23-9af3d694a645 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:17.064028 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109c34d-2473-4015-9f23-9af3d694a645 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:17.064028 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109c34d-2473-4015-9f23-9af3d694a645 None admin] PATH_INFO: `/v3/services` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:17.064569 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8109c34d-2473-4015-9f23-9af3d694a645 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:54:17.064892 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8109c34d-2473-4015-9f23-9af3d694a645 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:17.066245 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8109c34d-2473-4015-9f23-9af3d694a645 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:17.076741 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 402/795] 10.222.0.70 () {56 vars in 1112 bytes} [Fri Aug 19 15:54:16 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:54:17.093142 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47814336-35e9-48d6-8b37-042567636ba7 None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:17.093519 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47814336-35e9-48d6-8b37-042567636ba7 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:17.093883 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47814336-35e9-48d6-8b37-042567636ba7 None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:17.095334 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 394/796] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:54:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:54:17.101404 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e57226-581f-48d0-9f11-b53da5275ee1 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:17.101686 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e57226-581f-48d0-9f11-b53da5275ee1 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:17.101959 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e57226-581f-48d0-9f11-b53da5275ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:17.122251 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-56e57226-581f-48d0-9f11-b53da5275ee1 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:54:17.123385 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-56e57226-581f-48d0-9f11-b53da5275ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:54:17.197141 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 403/797] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:54:17 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:54:17.522419 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47814336-35e9-48d6-8b37-042567636ba7 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:54:17.627091 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47814336-35e9-48d6-8b37-042567636ba7 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:17.662638 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc29e2-1278-47ab-b470-7f931360bd70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:17.664539 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc29e2-1278-47ab-b470-7f931360bd70 None admin] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:17.664539 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc29e2-1278-47ab-b470-7f931360bd70 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:17.664539 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc29e2-1278-47ab-b470-7f931360bd70 None admin] PATH_INFO: `/v3/projects` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:17.664539 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbc29e2-1278-47ab-b470-7f931360bd70 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:17.665887 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbc29e2-1278-47ab-b470-7f931360bd70 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:17.668510 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: WARNING keystone.server.flask.common [None req-cbbc29e2-1278-47ab-b470-7f931360bd70 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 19 15:54:17.717703 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.sql.core [None req-cbbc29e2-1278-47ab-b470-7f931360bd70 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 19 15:54:17.717703 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 19 15:54:17.717703 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [parameters: {'id': 'd560946e3af64299b71e8697759178e8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 19 15:54:17.717703 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88367) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 19 15:54:17.735291 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-cbbc29e2-1278-47ab-b470-7f931360bd70 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d560946e3af64299b71e8697759178e8.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d560946e3af64299b71e8697759178e8. Aug 19 15:54:17.735291 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:54:17.735291 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 15:54:17.735291 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 15:54:17.735291 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 15:54:17.735291 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 15:54:17.735291 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 15:54:17.735291 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 15:54:17.735291 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 15:54:17.735291 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application conn.query(q) Aug 19 15:54:17.735291 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 15:54:17.735291 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 15:54:17.735291 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 15:54:17.736169 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application result.read() Aug 19 15:54:17.736169 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 15:54:17.736169 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 15:54:17.736169 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 15:54:17.736169 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 15:54:17.736169 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 15:54:17.736169 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 15:54:17.736169 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 15:54:17.736169 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 15:54:17.736169 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 19 15:54:17.736169 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:54:17.736169 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 19 15:54:17.736169 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:54:17.736169 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:54:17.736169 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 19 15:54:17.736169 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 19 15:54:17.736169 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 19 15:54:17.736169 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 19 15:54:17.737386 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 15:54:17.737386 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application next(self.gen) Aug 19 15:54:17.737386 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 19 15:54:17.737386 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application yield resource Aug 19 15:54:17.737386 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 15:54:17.737386 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application next(self.gen) Aug 19 15:54:17.737386 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 19 15:54:17.737386 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application self.session.rollback() Aug 19 15:54:17.737386 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 19 15:54:17.737386 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application self.force_reraise() Aug 19 15:54:17.737386 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 19 15:54:17.737386 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise self.value Aug 19 15:54:17.737386 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 19 15:54:17.737386 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 19 15:54:17.737386 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 19 15:54:17.737386 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application session.commit() Aug 19 15:54:17.737386 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 19 15:54:17.738491 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 19 15:54:17.738491 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 19 15:54:17.738491 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application self._prepare_impl() Aug 19 15:54:17.738491 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 19 15:54:17.738491 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application self.session.flush() Aug 19 15:54:17.738491 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 19 15:54:17.738491 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application self._flush(objects) Aug 19 15:54:17.738491 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 19 15:54:17.738491 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 19 15:54:17.738491 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 19 15:54:17.738491 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application compat.raise_( Aug 19 15:54:17.738491 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 15:54:17.738491 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception Aug 19 15:54:17.738491 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 19 15:54:17.738491 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application flush_context.execute() Aug 19 15:54:17.738491 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 19 15:54:17.738491 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rec.execute(self) Aug 19 15:54:17.739476 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 19 15:54:17.739476 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 19 15:54:17.739476 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 19 15:54:17.739476 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 19 15:54:17.739476 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 19 15:54:17.739476 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 19 15:54:17.739476 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 19 15:54:17.739476 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 19 15:54:17.739476 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 19 15:54:17.739476 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 19 15:54:17.739476 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 19 15:54:17.739476 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 19 15:54:17.739476 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 19 15:54:17.739476 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 19 15:54:17.739476 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 19 15:54:17.740267 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 19 15:54:17.740267 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 15:54:17.740267 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception Aug 19 15:54:17.740267 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 15:54:17.740267 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 15:54:17.740267 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 15:54:17.740267 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 15:54:17.740267 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 15:54:17.740267 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 15:54:17.740267 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 15:54:17.740267 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application conn.query(q) Aug 19 15:54:17.740267 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 15:54:17.740267 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 15:54:17.740267 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 15:54:17.740267 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application result.read() Aug 19 15:54:17.740267 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 15:54:17.740267 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 15:54:17.741214 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 15:54:17.741214 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 15:54:17.741214 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 15:54:17.741214 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 15:54:17.741214 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 15:54:17.741214 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 15:54:17.741214 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 19 15:54:17.741214 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 19 15:54:17.741214 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [parameters: {'id': 'd560946e3af64299b71e8697759178e8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 19 15:54:17.741214 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 19 15:54:17.741214 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:54:17.741214 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 15:54:17.741214 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:54:17.741214 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:54:17.741214 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 19 15:54:17.742659 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 19 15:54:17.742659 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 19 15:54:17.742659 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 19 15:54:17.742659 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 19 15:54:17.742659 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:54:17.742659 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 15:54:17.742659 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:54:17.742659 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:54:17.742659 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:54:17.742659 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:54:17.742659 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:54:17.742659 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:54:17.742659 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:54:17.742659 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:54:17.742659 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:54:17.742659 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:54:17.742659 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:54:17.743867 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:54:17.743867 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 19 15:54:17.743867 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 19 15:54:17.743867 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:54:17.743867 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:54:17.743867 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 19 15:54:17.743867 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 19 15:54:17.743867 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d560946e3af64299b71e8697759178e8. Aug 19 15:54:17.743867 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:54:17.743867 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 395/798] 10.222.0.70 () {60 vars in 1140 bytes} [Fri Aug 19 15:54:17 2022] POST /identity/v3/projects => generated 262 bytes in 215 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:54:17.745495 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e57226-581f-48d0-9f11-b53da5275ee1 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:54:17.863626 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e57226-581f-48d0-9f11-b53da5275ee1 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:17.880104 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:54:17.900422 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b103c1e-dc71-47a7-b7a1-3b73cbb2f25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:17.901106 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b103c1e-dc71-47a7-b7a1-3b73cbb2f25a None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:17.901375 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b103c1e-dc71-47a7-b7a1-3b73cbb2f25a None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:17.901709 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b103c1e-dc71-47a7-b7a1-3b73cbb2f25a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:17.908881 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b103c1e-dc71-47a7-b7a1-3b73cbb2f25a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:17.910314 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b103c1e-dc71-47a7-b7a1-3b73cbb2f25a None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:17.922602 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-8b103c1e-dc71-47a7-b7a1-3b73cbb2f25a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:54:17.922602 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:54:17.922602 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:54:17.922602 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:54:17.922602 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:54:17.922602 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:54:17.922602 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:54:17.922602 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:54:17.922602 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:54:17.922602 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:54:17.922602 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:54:17.922602 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:54:17.922602 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 15:54:17.922602 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 15:54:17.922602 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 15:54:17.923670 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 15:54:17.923670 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:54:17.923670 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:54:17.923670 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:54:17.923670 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:54:17.923670 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:54:17.923670 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:54:17.923670 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:54:17.923670 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:54:17.923670 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:54:17.923670 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:54:17.923670 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:54:17.923670 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:54:17.923670 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:54:17.923670 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:54:17.923670 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:54:17.923670 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:54:17.925036 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 15:54:17.925036 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 15:54:17.925036 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 15:54:17.925036 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 15:54:17.925036 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 15:54:17.925036 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 15:54:17.925036 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:54:17.925036 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:54:17.925036 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 404/799] 10.222.0.70 () {56 vars in 1111 bytes} [Fri Aug 19 15:54:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:54:17.929806 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc29e2-1278-47ab-b470-7f931360bd70 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:54:17.947727 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:54:18.039517 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc29e2-1278-47ab-b470-7f931360bd70 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:18.075620 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f5a08-216f-480d-b7e3-989ed47531d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:18.076249 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f5a08-216f-480d-b7e3-989ed47531d6 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:18.076526 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f5a08-216f-480d-b7e3-989ed47531d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:18.076825 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f5a08-216f-480d-b7e3-989ed47531d6 None admin] PATH_INFO: `/v3/projects` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:18.077496 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8f5a08-216f-480d-b7e3-989ed47531d6 None admin] RBAC: Adding query filter params (name=service) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:54:18.077799 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8f5a08-216f-480d-b7e3-989ed47531d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:18.079433 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8f5a08-216f-480d-b7e3-989ed47531d6 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:18.101016 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 396/800] 10.222.0.70 () {56 vars in 1112 bytes} [Fri Aug 19 15:54:17 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:54:19.325884 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d92329-3862-4162-bb1d-6821d9c105ba None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:19.326428 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d92329-3862-4162-bb1d-6821d9c105ba None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:19.326428 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d92329-3862-4162-bb1d-6821d9c105ba None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:19.327727 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 405/801] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:54:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:54:19.333199 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d286608-3514-4ae2-b73d-eebd0ed542ba None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:19.333624 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d286608-3514-4ae2-b73d-eebd0ed542ba None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:19.333741 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d286608-3514-4ae2-b73d-eebd0ed542ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:19.353429 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-1d286608-3514-4ae2-b73d-eebd0ed542ba None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:54:19.355270 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-1d286608-3514-4ae2-b73d-eebd0ed542ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:54:19.428877 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 397/802] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:54:19 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:54:19.764106 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d92329-3862-4162-bb1d-6821d9c105ba None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:54:19.872383 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d92329-3862-4162-bb1d-6821d9c105ba None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:19.912176 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157151fa-bcf7-4f40-8d80-3612bb29a295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:19.912826 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157151fa-bcf7-4f40-8d80-3612bb29a295 None admin] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:19.913096 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157151fa-bcf7-4f40-8d80-3612bb29a295 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:19.913361 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157151fa-bcf7-4f40-8d80-3612bb29a295 None admin] PATH_INFO: `/v3/services` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:19.913997 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157151fa-bcf7-4f40-8d80-3612bb29a295 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:19.916006 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157151fa-bcf7-4f40-8d80-3612bb29a295 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:20.067155 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 406/803] 10.222.0.70 () {60 vars in 1141 bytes} [Fri Aug 19 15:54:19 2022] POST /identity/v3/services => generated 242 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:54:20.388592 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a6ce3b-3133-435e-9531-7f9bdd606711 None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:20.389212 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a6ce3b-3133-435e-9531-7f9bdd606711 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:20.389212 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a6ce3b-3133-435e-9531-7f9bdd606711 None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:20.394022 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 398/804] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:54:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:54:20.396005 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881ede3-244c-4f84-b187-74d7cf25c591 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:20.396421 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881ede3-244c-4f84-b187-74d7cf25c591 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:20.396542 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881ede3-244c-4f84-b187-74d7cf25c591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:20.416386 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-6881ede3-244c-4f84-b187-74d7cf25c591 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:54:20.417617 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-6881ede3-244c-4f84-b187-74d7cf25c591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:54:20.445346 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:54:20.494157 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 407/805] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:54:20 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:54:20.828944 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a6ce3b-3133-435e-9531-7f9bdd606711 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:54:20.831921 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:54:20.927782 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a6ce3b-3133-435e-9531-7f9bdd606711 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:20.961269 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08001dfc-e876-41ae-a77c-c923925ff1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:20.961886 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08001dfc-e876-41ae-a77c-c923925ff1e6 None admin] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:20.962669 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08001dfc-e876-41ae-a77c-c923925ff1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:20.962934 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08001dfc-e876-41ae-a77c-c923925ff1e6 None admin] PATH_INFO: `/v3/users` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:20.963546 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08001dfc-e876-41ae-a77c-c923925ff1e6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:20.964976 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08001dfc-e876-41ae-a77c-c923925ff1e6 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:21.017772 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.sql.core [None req-08001dfc-e876-41ae-a77c-c923925ff1e6 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 19 15:54:21.017772 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 19 15:54:21.017772 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [parameters: {'user_id': '91f1af52618249e3810dce6f51e66219', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 19 15:54:21.017772 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88367) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 19 15:54:21.024314 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-08001dfc-e876-41ae-a77c-c923925ff1e6 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 19 15:54:21.024314 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:54:21.024314 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 15:54:21.024314 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 15:54:21.024314 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 15:54:21.024314 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 15:54:21.024314 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 15:54:21.024314 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 15:54:21.024314 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 15:54:21.024314 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application conn.query(q) Aug 19 15:54:21.024314 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 15:54:21.024314 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 15:54:21.024314 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 15:54:21.024314 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application result.read() Aug 19 15:54:21.024314 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 15:54:21.025680 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 15:54:21.025680 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 15:54:21.025680 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 15:54:21.025680 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 15:54:21.025680 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 15:54:21.025680 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 15:54:21.025680 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 15:54:21.025680 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 19 15:54:21.025680 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:54:21.025680 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 19 15:54:21.025680 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:54:21.025680 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:54:21.025680 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 19 15:54:21.025680 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 19 15:54:21.025680 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 19 15:54:21.025680 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 19 15:54:21.025680 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 15:54:21.025680 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application next(self.gen) Aug 19 15:54:21.026612 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 19 15:54:21.026612 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application yield resource Aug 19 15:54:21.026612 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 15:54:21.026612 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application next(self.gen) Aug 19 15:54:21.026612 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 19 15:54:21.026612 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application self.session.rollback() Aug 19 15:54:21.026612 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 19 15:54:21.026612 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application self.force_reraise() Aug 19 15:54:21.026612 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 19 15:54:21.026612 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise self.value Aug 19 15:54:21.026612 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 19 15:54:21.026612 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 19 15:54:21.026612 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 19 15:54:21.026612 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application session.commit() Aug 19 15:54:21.026612 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 19 15:54:21.026612 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 19 15:54:21.026612 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 19 15:54:21.027487 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application self._prepare_impl() Aug 19 15:54:21.027487 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 19 15:54:21.027487 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application self.session.flush() Aug 19 15:54:21.027487 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 19 15:54:21.027487 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application self._flush(objects) Aug 19 15:54:21.027487 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 19 15:54:21.027487 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 19 15:54:21.027487 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 19 15:54:21.027487 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application compat.raise_( Aug 19 15:54:21.027487 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 15:54:21.027487 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception Aug 19 15:54:21.027487 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 19 15:54:21.027487 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application flush_context.execute() Aug 19 15:54:21.027487 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 19 15:54:21.027487 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rec.execute(self) Aug 19 15:54:21.027487 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 19 15:54:21.027487 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 19 15:54:21.028370 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 19 15:54:21.028370 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 19 15:54:21.028370 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 19 15:54:21.028370 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 19 15:54:21.028370 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 19 15:54:21.028370 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 19 15:54:21.028370 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 19 15:54:21.028370 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 19 15:54:21.028370 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 19 15:54:21.028370 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 19 15:54:21.028370 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 19 15:54:21.028370 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 19 15:54:21.028370 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 19 15:54:21.028370 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 19 15:54:21.028370 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 15:54:21.028370 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception Aug 19 15:54:21.029273 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 15:54:21.029273 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 15:54:21.029273 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 15:54:21.029273 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 15:54:21.029273 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 15:54:21.029273 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 15:54:21.029273 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 15:54:21.029273 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application conn.query(q) Aug 19 15:54:21.029273 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 15:54:21.029273 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 15:54:21.029273 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 15:54:21.029273 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application result.read() Aug 19 15:54:21.029273 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 15:54:21.029273 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 15:54:21.029273 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 15:54:21.029273 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 15:54:21.030090 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 15:54:21.030090 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 15:54:21.030090 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 15:54:21.030090 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 15:54:21.030090 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 19 15:54:21.030090 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 19 15:54:21.030090 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [parameters: {'user_id': '91f1af52618249e3810dce6f51e66219', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 19 15:54:21.030090 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 19 15:54:21.030090 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:54:21.030090 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 15:54:21.030090 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:54:21.030090 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:54:21.030090 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:54:21.030090 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:54:21.030090 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:54:21.030879 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:54:21.030879 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:54:21.030879 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:54:21.030879 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:54:21.030879 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:54:21.030879 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:54:21.030879 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:54:21.030879 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 19 15:54:21.030879 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 19 15:54:21.030879 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:54:21.030879 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:54:21.030879 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 15:54:21.030879 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:54:21.030879 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 15:54:21.030879 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:54:21.030879 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 19 15:54:21.030879 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 19 15:54:21.031805 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 19 15:54:21.031805 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 19 15:54:21.031805 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 19 15:54:21.031805 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 19 15:54:21.031805 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 19 15:54:21.031805 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:54:21.031805 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 399/806] 10.222.0.70 () {60 vars in 1131 bytes} [Fri Aug 19 15:54:20 2022] POST /identity/v3/users => generated 160 bytes in 198 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:54:21.032241 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6881ede3-244c-4f84-b187-74d7cf25c591 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:54:21.131705 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6881ede3-244c-4f84-b187-74d7cf25c591 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:21.166550 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d971c7-f576-4ca3-aaf8-7dd92f121d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:21.167168 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d971c7-f576-4ca3-aaf8-7dd92f121d07 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:21.167459 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d971c7-f576-4ca3-aaf8-7dd92f121d07 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:21.167727 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d971c7-f576-4ca3-aaf8-7dd92f121d07 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:21.174791 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d971c7-f576-4ca3-aaf8-7dd92f121d07 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:21.176214 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d971c7-f576-4ca3-aaf8-7dd92f121d07 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:21.188353 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-c2d971c7-f576-4ca3-aaf8-7dd92f121d07 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 15:54:21.188353 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:54:21.188353 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:54:21.188353 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:54:21.188353 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:54:21.188353 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:54:21.188353 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:54:21.188353 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:54:21.188353 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:54:21.188353 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:54:21.188353 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:54:21.188353 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:54:21.188353 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 15:54:21.188353 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 15:54:21.188353 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 15:54:21.188353 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 15:54:21.189365 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:54:21.189365 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:54:21.189365 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 15:54:21.189365 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:54:21.189365 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 15:54:21.189365 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:54:21.189365 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:54:21.189365 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:54:21.189365 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:54:21.189365 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:54:21.189365 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:54:21.189365 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:54:21.189365 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:54:21.189365 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:54:21.189365 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:54:21.189365 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:54:21.189365 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:54:21.189365 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:54:21.190304 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:54:21.190304 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:54:21.190304 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 15:54:21.190304 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 15:54:21.190304 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 15:54:21.190304 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 15:54:21.190304 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 15:54:21.190304 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 15:54:21.190304 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 15:54:21.190304 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:54:21.190304 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 408/807] 10.222.0.70 () {56 vars in 1099 bytes} [Fri Aug 19 15:54:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:54:21.196016 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08001dfc-e876-41ae-a77c-c923925ff1e6 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:54:21.261388 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:54:21.300424 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08001dfc-e876-41ae-a77c-c923925ff1e6 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:21.334010 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f2083e-c196-442e-a68b-322b0e7d46a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:21.334603 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2083e-c196-442e-a68b-322b0e7d46a4 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:21.334875 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2083e-c196-442e-a68b-322b0e7d46a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:21.335137 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2083e-c196-442e-a68b-322b0e7d46a4 None admin] PATH_INFO: `/v3/users` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:21.335813 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f2083e-c196-442e-a68b-322b0e7d46a4 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:54:21.336107 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f2083e-c196-442e-a68b-322b0e7d46a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:21.338771 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f2083e-c196-442e-a68b-322b0e7d46a4 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:21.379224 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 400/808] 10.222.0.70 () {56 vars in 1101 bytes} [Fri Aug 19 15:54:21 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:54:22.309075 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b5dc1-1de5-4288-a988-eb0cd3b6161d None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:22.309643 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b5dc1-1de5-4288-a988-eb0cd3b6161d None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:22.309643 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b5dc1-1de5-4288-a988-eb0cd3b6161d None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:22.310894 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 409/809] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:54:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:54:22.316207 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc533689-5923-4a39-893d-994da9938996 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:22.316657 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc533689-5923-4a39-893d-994da9938996 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:22.316803 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc533689-5923-4a39-893d-994da9938996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:22.336337 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-fc533689-5923-4a39-893d-994da9938996 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:54:22.338064 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-fc533689-5923-4a39-893d-994da9938996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:54:22.406869 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 401/810] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:54:22 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:54:22.747069 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b5dc1-1de5-4288-a988-eb0cd3b6161d None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:54:22.770363 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:54:22.849237 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b5dc1-1de5-4288-a988-eb0cd3b6161d None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:22.884822 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20341372-8604-4b67-9baf-69391b768647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:22.885474 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20341372-8604-4b67-9baf-69391b768647 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:22.885752 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20341372-8604-4b67-9baf-69391b768647 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:22.886026 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20341372-8604-4b67-9baf-69391b768647 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:22.886685 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20341372-8604-4b67-9baf-69391b768647 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:22.888056 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20341372-8604-4b67-9baf-69391b768647 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:22.896969 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-20341372-8604-4b67-9baf-69391b768647 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 15:54:22.896969 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:54:22.896969 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 15:54:22.896969 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 15:54:22.896969 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 15:54:22.896969 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 15:54:22.896969 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 15:54:22.896969 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:54:22.896969 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 15:54:22.896969 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:54:22.896969 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 15:54:22.896969 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:54:22.896969 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:54:22.896969 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:54:22.896969 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:54:22.896969 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:54:22.896969 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:54:22.897985 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:54:22.897985 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:54:22.897985 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:54:22.897985 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:54:22.897985 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:54:22.897985 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:54:22.897985 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 15:54:22.897985 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 15:54:22.897985 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 15:54:22.897985 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 15:54:22.897985 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:54:22.897985 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:54:22.897985 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:54:22.897985 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:54:22.897985 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:54:22.897985 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:54:22.899008 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:54:22.899008 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:54:22.899008 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:54:22.899008 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:54:22.899008 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:54:22.899008 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:54:22.899008 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:54:22.899008 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:54:22.899008 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:54:22.899008 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:54:22.899008 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 15:54:22.899008 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:54:22.899008 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 15:54:22.899008 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:54:22.899008 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 410/811] 10.222.0.70 () {56 vars in 1111 bytes} [Fri Aug 19 15:54:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:54:22.904281 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc533689-5923-4a39-893d-994da9938996 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:54:22.957878 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:54:23.005964 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc533689-5923-4a39-893d-994da9938996 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:23.038891 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b8003-3610-405e-9295-e688e7761625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:23.039494 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b8003-3610-405e-9295-e688e7761625 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:23.039770 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b8003-3610-405e-9295-e688e7761625 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:23.040039 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b8003-3610-405e-9295-e688e7761625 None admin] PATH_INFO: `/v3/services` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:23.041292 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3b8003-3610-405e-9295-e688e7761625 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:54:23.041593 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3b8003-3610-405e-9295-e688e7761625 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:23.042946 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3b8003-3610-405e-9295-e688e7761625 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:23.047672 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 402/812] 10.222.0.70 () {56 vars in 1112 bytes} [Fri Aug 19 15:54:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:54:23.053549 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20341372-8604-4b67-9baf-69391b768647 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:54:23.140341 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:54:23.155517 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20341372-8604-4b67-9baf-69391b768647 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:23.190037 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca0d378-2458-4a0a-b392-df84db9399b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:23.190637 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0d378-2458-4a0a-b392-df84db9399b1 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:23.190909 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0d378-2458-4a0a-b392-df84db9399b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:23.191173 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0d378-2458-4a0a-b392-df84db9399b1 None admin] PATH_INFO: `/v3/services` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:23.191790 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca0d378-2458-4a0a-b392-df84db9399b1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:54:23.192084 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca0d378-2458-4a0a-b392-df84db9399b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:23.193469 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca0d378-2458-4a0a-b392-df84db9399b1 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:23.198408 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 411/813] 10.222.0.70 () {56 vars in 1112 bytes} [Fri Aug 19 15:54:23 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:54:23.204596 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b8003-3610-405e-9295-e688e7761625 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:54:23.307011 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b8003-3610-405e-9295-e688e7761625 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:23.322737 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:54:23.341226 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6196fc5-82b9-4150-80fd-a4f270236ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:23.341828 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6196fc5-82b9-4150-80fd-a4f270236ab5 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:23.342104 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6196fc5-82b9-4150-80fd-a4f270236ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:23.342375 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6196fc5-82b9-4150-80fd-a4f270236ab5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:23.343073 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6196fc5-82b9-4150-80fd-a4f270236ab5 None admin] RBAC: Adding query filter params (interface=public, service_id=10f6dab65ade4cf38dd162c966fba045, region_id=RegionOne) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:54:23.343468 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6196fc5-82b9-4150-80fd-a4f270236ab5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:23.344847 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6196fc5-82b9-4150-80fd-a4f270236ab5 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:23.350241 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 403/814] 10.222.0.70 () {56 vars in 1251 bytes} [Fri Aug 19 15:54:23 2022] GET /identity/v3/endpoints?service_id=10f6dab65ade4cf38dd162c966fba045&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:54:23.356704 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca0d378-2458-4a0a-b392-df84db9399b1 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:54:23.455463 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca0d378-2458-4a0a-b392-df84db9399b1 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:23.489651 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc49ee-bd23-4466-a706-e72a95d30673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:23.490243 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc49ee-bd23-4466-a706-e72a95d30673 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:23.490519 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc49ee-bd23-4466-a706-e72a95d30673 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:23.490788 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc49ee-bd23-4466-a706-e72a95d30673 None admin] PATH_INFO: `/v3/services` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:23.491378 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc49ee-bd23-4466-a706-e72a95d30673 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:23.492776 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc49ee-bd23-4466-a706-e72a95d30673 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:23.499404 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 412/815] 10.222.0.70 () {56 vars in 1087 bytes} [Fri Aug 19 15:54:23 2022] GET /identity/v3/services => generated 1728 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:54:25.776125 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da2883-f972-493d-afff-862432eaf615 None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:25.776784 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da2883-f972-493d-afff-862432eaf615 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:25.776890 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da2883-f972-493d-afff-862432eaf615 None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:25.778230 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 404/816] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:54:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:54:25.783669 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b3d64-dc93-4293-ae43-12870d424253 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:25.784120 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b3d64-dc93-4293-ae43-12870d424253 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:25.784215 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b3d64-dc93-4293-ae43-12870d424253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:25.803150 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-977b3d64-dc93-4293-ae43-12870d424253 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:54:25.804342 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-977b3d64-dc93-4293-ae43-12870d424253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:54:25.813047 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:54:25.874470 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 413/817] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:54:25 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:54:26.203944 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da2883-f972-493d-afff-862432eaf615 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:54:26.315343 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da2883-f972-493d-afff-862432eaf615 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:26.349325 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ebb29-9384-4bcc-8eda-2f1328579d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:26.349962 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ebb29-9384-4bcc-8eda-2f1328579d6c None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:26.350237 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ebb29-9384-4bcc-8eda-2f1328579d6c None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:26.350508 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ebb29-9384-4bcc-8eda-2f1328579d6c None admin] PATH_INFO: `/v3/services/compute` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:26.351116 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614ebb29-9384-4bcc-8eda-2f1328579d6c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:26.352516 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614ebb29-9384-4bcc-8eda-2f1328579d6c None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:26.362748 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-614ebb29-9384-4bcc-8eda-2f1328579d6c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 15:54:26.362748 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:54:26.362748 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 15:54:26.362748 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 15:54:26.362748 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 15:54:26.362748 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 15:54:26.362748 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 15:54:26.362748 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:54:26.362748 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 15:54:26.362748 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:54:26.362748 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 15:54:26.362748 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:54:26.362748 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:54:26.362748 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:54:26.362748 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:54:26.362748 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:54:26.362748 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:54:26.363954 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:54:26.363954 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:54:26.363954 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:54:26.363954 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:54:26.363954 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:54:26.363954 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:54:26.363954 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 15:54:26.363954 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 15:54:26.363954 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 15:54:26.363954 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 15:54:26.363954 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:54:26.363954 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:54:26.363954 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:54:26.363954 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:54:26.363954 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:54:26.363954 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:54:26.364917 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:54:26.364917 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:54:26.364917 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:54:26.364917 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:54:26.364917 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:54:26.364917 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:54:26.364917 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:54:26.364917 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:54:26.364917 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:54:26.364917 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:54:26.364917 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 15:54:26.364917 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:54:26.364917 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 15:54:26.364917 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:54:26.364917 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 405/818] 10.222.0.70 () {56 vars in 1111 bytes} [Fri Aug 19 15:54:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:54:26.370007 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b3d64-dc93-4293-ae43-12870d424253 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:54:26.475096 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b3d64-dc93-4293-ae43-12870d424253 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:26.510782 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9ea694-b991-4b05-b390-fe089b7b5564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:26.511392 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ea694-b991-4b05-b390-fe089b7b5564 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:26.511666 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ea694-b991-4b05-b390-fe089b7b5564 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:26.511929 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ea694-b991-4b05-b390-fe089b7b5564 None admin] PATH_INFO: `/v3/services` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:26.512545 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9ea694-b991-4b05-b390-fe089b7b5564 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:54:26.512866 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9ea694-b991-4b05-b390-fe089b7b5564 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:26.514221 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9ea694-b991-4b05-b390-fe089b7b5564 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:26.519128 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 414/819] 10.222.0.70 () {56 vars in 1112 bytes} [Fri Aug 19 15:54:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:54:26.525575 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ebb29-9384-4bcc-8eda-2f1328579d6c None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:54:26.572590 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:54:26.629295 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ebb29-9384-4bcc-8eda-2f1328579d6c None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:26.665706 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035ed980-1ebb-4532-8900-914e601a8b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:26.666313 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ed980-1ebb-4532-8900-914e601a8b68 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:26.666589 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ed980-1ebb-4532-8900-914e601a8b68 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:26.666856 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ed980-1ebb-4532-8900-914e601a8b68 None admin] PATH_INFO: `/v3/services` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:26.667485 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035ed980-1ebb-4532-8900-914e601a8b68 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:54:26.667785 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035ed980-1ebb-4532-8900-914e601a8b68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:26.669188 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035ed980-1ebb-4532-8900-914e601a8b68 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:26.674300 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 406/820] 10.222.0.70 () {56 vars in 1112 bytes} [Fri Aug 19 15:54:26 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:54:26.680391 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9ea694-b991-4b05-b390-fe089b7b5564 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:54:26.696179 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:54:26.788012 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9ea694-b991-4b05-b390-fe089b7b5564 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:54:26.824522 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd2623b-54a9-42db-aebf-4e882fd0bec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:54:26.825146 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2623b-54a9-42db-aebf-4e882fd0bec8 None admin] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:54:26.825419 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2623b-54a9-42db-aebf-4e882fd0bec8 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:54:26.825686 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2623b-54a9-42db-aebf-4e882fd0bec8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:54:26.826349 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd2623b-54a9-42db-aebf-4e882fd0bec8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:54:26.827705 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd2623b-54a9-42db-aebf-4e882fd0bec8 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:54:26.905144 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 415/821] 10.222.0.70 () {60 vars in 1144 bytes} [Fri Aug 19 15:54:26 2022] POST /identity/v3/endpoints => generated 334 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:54:36.671827 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=46 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:54:36.900159 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=68,keystone:INSERT=1 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:55:53.809820 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5baa0-218b-468a-9071-b1957dd8241f None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:55:53.810740 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5baa0-218b-468a-9071-b1957dd8241f None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:55:53.810740 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5baa0-218b-468a-9071-b1957dd8241f None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:55:53.813844 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 407/822] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:55:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:55:53.818230 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd22d6e-b452-4392-934d-b5d1941d0cbe None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:55:53.818715 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd22d6e-b452-4392-934d-b5d1941d0cbe None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:55:53.818813 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd22d6e-b452-4392-934d-b5d1941d0cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:55:53.837874 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-dbd22d6e-b452-4392-934d-b5d1941d0cbe None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:55:53.839778 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-dbd22d6e-b452-4392-934d-b5d1941d0cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:55:53.924544 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 416/823] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:55:53 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:55:54.262186 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe5baa0-218b-468a-9071-b1957dd8241f None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:55:54.365907 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe5baa0-218b-468a-9071-b1957dd8241f None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:55:54.400613 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6896ed-733a-4ec2-9bb4-cb0083e611ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:55:54.401874 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6896ed-733a-4ec2-9bb4-cb0083e611ae None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:55:54.402147 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6896ed-733a-4ec2-9bb4-cb0083e611ae None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:55:54.402418 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6896ed-733a-4ec2-9bb4-cb0083e611ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:55:54.412608 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6896ed-733a-4ec2-9bb4-cb0083e611ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:55:54.414075 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6896ed-733a-4ec2-9bb4-cb0083e611ae None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:55:54.428679 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-2b6896ed-733a-4ec2-9bb4-cb0083e611ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:55:54.428679 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:55:54.428679 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:55:54.428679 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:55:54.428679 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:55:54.428679 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:55:54.428679 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:55:54.428679 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:55:54.428679 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:55:54.428679 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:55:54.428679 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:55:54.428679 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:55:54.428679 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:55:54.428679 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:55:54.428679 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:55:54.428679 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:55:54.429936 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:55:54.429936 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:55:54.429936 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:55:54.429936 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:55:54.429936 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:55:54.429936 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:55:54.429936 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:55:54.429936 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:55:54.429936 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:55:54.429936 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:55:54.429936 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:55:54.429936 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:55:54.429936 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:55:54.429936 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:55:54.429936 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:55:54.429936 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:55:54.429936 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:55:54.430933 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:55:54.430933 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:55:54.430933 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:55:54.430933 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 408/824] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:55:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:55:54.440463 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd22d6e-b452-4392-934d-b5d1941d0cbe None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:55:54.541542 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd22d6e-b452-4392-934d-b5d1941d0cbe None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:55:54.570865 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:55:54.581330 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d684e4-fdc5-430a-bae2-84306c23dfe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:55:54.581934 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d684e4-fdc5-430a-bae2-84306c23dfe9 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:55:54.582208 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d684e4-fdc5-430a-bae2-84306c23dfe9 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:55:54.582475 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d684e4-fdc5-430a-bae2-84306c23dfe9 None admin] PATH_INFO: `/v3/domains` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:55:54.583117 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d684e4-fdc5-430a-bae2-84306c23dfe9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:55:54.583415 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d684e4-fdc5-430a-bae2-84306c23dfe9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:55:54.584801 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d684e4-fdc5-430a-bae2-84306c23dfe9 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:55:54.597019 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 417/825] 10.222.0.70 () {56 vars in 1109 bytes} [Fri Aug 19 15:55:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:55:54.603243 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6896ed-733a-4ec2-9bb4-cb0083e611ae None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:55:54.691396 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:55:54.744379 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6896ed-733a-4ec2-9bb4-cb0083e611ae None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:55:54.779297 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48fab80-ec69-4fde-b1a3-3ea9aa88b962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:55:54.779905 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48fab80-ec69-4fde-b1a3-3ea9aa88b962 None admin] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:55:54.780181 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48fab80-ec69-4fde-b1a3-3ea9aa88b962 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:55:54.780451 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48fab80-ec69-4fde-b1a3-3ea9aa88b962 None admin] PATH_INFO: `/v3/users` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:55:54.781168 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48fab80-ec69-4fde-b1a3-3ea9aa88b962 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:55:54.782589 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48fab80-ec69-4fde-b1a3-3ea9aa88b962 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:55:54.883423 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 409/826] 10.222.0.70 () {60 vars in 1132 bytes} [Fri Aug 19 15:55:54 2022] POST /identity/v3/users => generated 251 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:55:57.144043 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf639156-e707-4b29-bd2c-2f6919391ebb None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:55:57.144603 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf639156-e707-4b29-bd2c-2f6919391ebb None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:55:57.144603 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf639156-e707-4b29-bd2c-2f6919391ebb None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:55:57.145953 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 418/827] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:55:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:55:57.152133 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e942610c-0406-4d3c-85f6-ccab709b67f3 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:55:57.156978 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e942610c-0406-4d3c-85f6-ccab709b67f3 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:55:57.156978 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e942610c-0406-4d3c-85f6-ccab709b67f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:55:57.172403 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-e942610c-0406-4d3c-85f6-ccab709b67f3 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:55:57.173662 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-e942610c-0406-4d3c-85f6-ccab709b67f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:55:57.243915 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 410/828] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:55:57 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:55:57.577099 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf639156-e707-4b29-bd2c-2f6919391ebb None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:55:57.685569 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf639156-e707-4b29-bd2c-2f6919391ebb None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:55:57.721120 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485e732-ec87-4844-8fa3-28803759a80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:55:57.722439 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485e732-ec87-4844-8fa3-28803759a80c None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:55:57.722714 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485e732-ec87-4844-8fa3-28803759a80c None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:55:57.722994 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485e732-ec87-4844-8fa3-28803759a80c None admin] PATH_INFO: `/v3/roles/service` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:55:57.735605 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485e732-ec87-4844-8fa3-28803759a80c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:55:57.742650 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-1485e732-ec87-4844-8fa3-28803759a80c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:55:57.742650 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:55:57.742650 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:55:57.742650 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:55:57.742650 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:55:57.742650 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:55:57.742650 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:55:57.742650 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:55:57.742650 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:55:57.742650 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:55:57.742650 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:55:57.742650 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:55:57.742650 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:55:57.742650 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:55:57.742650 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:55:57.742650 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:55:57.752841 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:55:57.752841 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:55:57.752841 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:55:57.752841 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:55:57.752841 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:55:57.752841 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:55:57.752841 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:55:57.752841 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:55:57.752841 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:55:57.752841 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:55:57.752841 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:55:57.752841 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:55:57.752841 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:55:57.752841 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:55:57.752841 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:55:57.752841 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:55:57.753733 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:55:57.753733 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:55:57.753733 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:55:57.753733 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:55:57.753733 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:55:57.753733 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:55:57.753733 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:55:57.753733 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:55:57.753733 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:55:57.753733 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:55:57.753733 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:55:57.753733 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:55:57.753733 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 419/829] 10.222.0.70 () {56 vars in 1102 bytes} [Fri Aug 19 15:55:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:55:57.754480 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e942610c-0406-4d3c-85f6-ccab709b67f3 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:55:57.791954 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:55:57.851277 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e942610c-0406-4d3c-85f6-ccab709b67f3 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:55:57.885659 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562bfc37-4224-47c8-ba99-06b67b774b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:55:57.886343 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562bfc37-4224-47c8-ba99-06b67b774b01 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:55:57.886633 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562bfc37-4224-47c8-ba99-06b67b774b01 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:55:57.886906 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562bfc37-4224-47c8-ba99-06b67b774b01 None admin] PATH_INFO: `/v3/roles` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:55:57.887567 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562bfc37-4224-47c8-ba99-06b67b774b01 None admin] RBAC: Adding query filter params (name=service) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:55:57.887868 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562bfc37-4224-47c8-ba99-06b67b774b01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:55:57.889270 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562bfc37-4224-47c8-ba99-06b67b774b01 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:55:57.897523 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 411/830] 10.222.0.70 () {56 vars in 1103 bytes} [Fri Aug 19 15:55:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:55:57.904121 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485e732-ec87-4844-8fa3-28803759a80c None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:55:57.951083 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:55:58.005264 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485e732-ec87-4844-8fa3-28803759a80c None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:55:58.045951 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0459b71e-088d-4528-8ca0-e034d0c6af0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:55:58.046581 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459b71e-088d-4528-8ca0-e034d0c6af0c None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:55:58.046854 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459b71e-088d-4528-8ca0-e034d0c6af0c None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:55:58.047124 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459b71e-088d-4528-8ca0-e034d0c6af0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:55:58.058070 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0459b71e-088d-4528-8ca0-e034d0c6af0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:55:58.059508 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0459b71e-088d-4528-8ca0-e034d0c6af0c None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:55:58.074098 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-0459b71e-088d-4528-8ca0-e034d0c6af0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:55:58.074098 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:55:58.074098 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:55:58.074098 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:55:58.074098 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:55:58.074098 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:55:58.074098 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:55:58.074098 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:55:58.074098 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:55:58.074098 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:55:58.074098 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:55:58.074098 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:55:58.074098 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:55:58.074098 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:55:58.074098 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:55:58.074098 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:55:58.075255 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:55:58.075255 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:55:58.075255 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:55:58.075255 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:55:58.075255 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:55:58.075255 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:55:58.075255 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:55:58.075255 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:55:58.075255 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:55:58.075255 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:55:58.075255 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:55:58.075255 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:55:58.075255 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:55:58.075255 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:55:58.075255 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:55:58.075255 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:55:58.075255 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:55:58.076189 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:55:58.076189 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:55:58.076189 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:55:58.076189 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 420/831] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:55:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:55:58.081315 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562bfc37-4224-47c8-ba99-06b67b774b01 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:55:58.183464 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:55:58.186362 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562bfc37-4224-47c8-ba99-06b67b774b01 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:55:58.223679 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d058a1-8c7d-4107-9170-865478f40148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:55:58.224342 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d058a1-8c7d-4107-9170-865478f40148 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:55:58.224607 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d058a1-8c7d-4107-9170-865478f40148 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:55:58.224907 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d058a1-8c7d-4107-9170-865478f40148 None admin] PATH_INFO: `/v3/domains` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:55:58.225551 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d058a1-8c7d-4107-9170-865478f40148 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:55:58.225853 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d058a1-8c7d-4107-9170-865478f40148 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:55:58.227218 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d058a1-8c7d-4107-9170-865478f40148 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:55:58.239847 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 412/832] 10.222.0.70 () {56 vars in 1109 bytes} [Fri Aug 19 15:55:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:55:58.246291 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0459b71e-088d-4528-8ca0-e034d0c6af0c None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:55:58.357064 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:55:58.360884 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0459b71e-088d-4528-8ca0-e034d0c6af0c None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:55:58.395962 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3d602-5b35-4511-84f1-65d41ccf23cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:55:58.396588 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3d602-5b35-4511-84f1-65d41ccf23cf None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:55:58.396892 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3d602-5b35-4511-84f1-65d41ccf23cf None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:55:58.397159 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3d602-5b35-4511-84f1-65d41ccf23cf None admin] PATH_INFO: `/v3/users/placement` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:55:58.405510 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b3d602-5b35-4511-84f1-65d41ccf23cf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:55:58.406965 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b3d602-5b35-4511-84f1-65d41ccf23cf None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:55:58.418906 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-d4b3d602-5b35-4511-84f1-65d41ccf23cf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 15:55:58.418906 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:55:58.418906 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:55:58.418906 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:55:58.418906 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:55:58.418906 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:55:58.418906 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:55:58.418906 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:55:58.418906 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:55:58.418906 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:55:58.418906 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:55:58.418906 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:55:58.418906 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 15:55:58.418906 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 15:55:58.418906 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 15:55:58.418906 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 15:55:58.420143 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:55:58.420143 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:55:58.420143 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 15:55:58.420143 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:55:58.420143 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 15:55:58.420143 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:55:58.420143 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:55:58.420143 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:55:58.420143 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:55:58.420143 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:55:58.420143 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:55:58.420143 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:55:58.420143 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:55:58.420143 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:55:58.420143 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:55:58.420143 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:55:58.420143 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:55:58.420143 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:55:58.421352 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:55:58.421352 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:55:58.421352 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 15:55:58.421352 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 15:55:58.421352 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 15:55:58.421352 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 15:55:58.421352 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 15:55:58.421352 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 15:55:58.421352 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 15:55:58.421352 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:55:58.421352 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 421/833] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:55:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:55:58.426188 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d058a1-8c7d-4107-9170-865478f40148 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:55:58.529031 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d058a1-8c7d-4107-9170-865478f40148 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:55:58.564950 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab100c4d-eb68-42de-8837-edcc5c025110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:55:58.565554 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab100c4d-eb68-42de-8837-edcc5c025110 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:55:58.565851 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab100c4d-eb68-42de-8837-edcc5c025110 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:55:58.566146 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab100c4d-eb68-42de-8837-edcc5c025110 None admin] PATH_INFO: `/v3/users` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:55:58.566961 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab100c4d-eb68-42de-8837-edcc5c025110 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:55:58.567278 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab100c4d-eb68-42de-8837-edcc5c025110 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:55:58.568710 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab100c4d-eb68-42de-8837-edcc5c025110 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:55:58.586304 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 413/834] 10.222.0.70 () {56 vars in 1143 bytes} [Fri Aug 19 15:55:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:55:58.592440 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3d602-5b35-4511-84f1-65d41ccf23cf None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:55:58.695860 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3d602-5b35-4511-84f1-65d41ccf23cf None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:55:58.732965 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc4872-8843-4a23-b9e7-300aebbf6d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:55:58.733575 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc4872-8843-4a23-b9e7-300aebbf6d8e None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:55:58.733850 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc4872-8843-4a23-b9e7-300aebbf6d8e None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:55:58.734120 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc4872-8843-4a23-b9e7-300aebbf6d8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:55:58.766591 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:55:58.806481 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cc4872-8843-4a23-b9e7-300aebbf6d8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:55:58.808545 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cc4872-8843-4a23-b9e7-300aebbf6d8e None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:55:58.904833 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 422/835] 10.222.0.70 () {58 vars in 1282 bytes} [Fri Aug 19 15:55:58 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 15:55:58.910887 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab100c4d-eb68-42de-8837-edcc5c025110 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:55:58.930474 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:55:59.010848 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab100c4d-eb68-42de-8837-edcc5c025110 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:55:59.055046 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070a446-4591-40b6-88e5-eeaa3de26012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:55:59.055682 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070a446-4591-40b6-88e5-eeaa3de26012 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:55:59.055959 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070a446-4591-40b6-88e5-eeaa3de26012 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:55:59.056228 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070a446-4591-40b6-88e5-eeaa3de26012 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:55:59.066648 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c070a446-4591-40b6-88e5-eeaa3de26012 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:55:59.068016 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c070a446-4591-40b6-88e5-eeaa3de26012 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:55:59.083369 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-c070a446-4591-40b6-88e5-eeaa3de26012 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:55:59.083369 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:55:59.083369 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:55:59.083369 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:55:59.083369 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:55:59.083369 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:55:59.083369 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:55:59.083369 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:55:59.083369 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:55:59.083369 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:55:59.083369 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:55:59.083369 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:55:59.083369 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:55:59.083369 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:55:59.083369 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:55:59.083369 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:55:59.084524 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:55:59.084524 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:55:59.084524 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:55:59.084524 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:55:59.084524 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:55:59.084524 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:55:59.084524 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:55:59.084524 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:55:59.084524 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:55:59.084524 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:55:59.084524 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:55:59.084524 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:55:59.084524 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:55:59.084524 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:55:59.084524 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:55:59.084524 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:55:59.084524 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:55:59.085490 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:55:59.085490 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:55:59.085490 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:55:59.085490 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 414/836] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:55:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:55:59.090833 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc4872-8843-4a23-b9e7-300aebbf6d8e None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:55:59.152212 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:55:59.193240 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc4872-8843-4a23-b9e7-300aebbf6d8e None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:55:59.227220 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace5000-c153-4331-84cc-6deefd830aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:55:59.227819 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace5000-c153-4331-84cc-6deefd830aa7 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:55:59.228095 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace5000-c153-4331-84cc-6deefd830aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:55:59.228364 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace5000-c153-4331-84cc-6deefd830aa7 None admin] PATH_INFO: `/v3/domains` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:55:59.229552 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace5000-c153-4331-84cc-6deefd830aa7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:55:59.229846 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace5000-c153-4331-84cc-6deefd830aa7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:55:59.231202 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace5000-c153-4331-84cc-6deefd830aa7 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:55:59.242206 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 423/837] 10.222.0.70 () {56 vars in 1109 bytes} [Fri Aug 19 15:55:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:55:59.248842 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070a446-4591-40b6-88e5-eeaa3de26012 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:55:59.318576 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:55:59.347785 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070a446-4591-40b6-88e5-eeaa3de26012 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:55:59.382644 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e5bc70-56a8-4eff-ada9-1eb75b725e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:55:59.383273 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5bc70-56a8-4eff-ada9-1eb75b725e87 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:55:59.383548 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5bc70-56a8-4eff-ada9-1eb75b725e87 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:55:59.383819 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5bc70-56a8-4eff-ada9-1eb75b725e87 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:55:59.390386 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e5bc70-56a8-4eff-ada9-1eb75b725e87 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:55:59.391811 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e5bc70-56a8-4eff-ada9-1eb75b725e87 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:55:59.402793 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-b3e5bc70-56a8-4eff-ada9-1eb75b725e87 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:55:59.402793 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:55:59.402793 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:55:59.402793 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:55:59.402793 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:55:59.402793 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:55:59.402793 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:55:59.402793 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:55:59.402793 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:55:59.402793 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:55:59.402793 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:55:59.402793 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:55:59.402793 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 15:55:59.402793 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 15:55:59.402793 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 15:55:59.403847 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 15:55:59.403847 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:55:59.403847 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:55:59.403847 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:55:59.403847 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:55:59.403847 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:55:59.403847 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:55:59.403847 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:55:59.403847 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:55:59.403847 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:55:59.403847 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:55:59.403847 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:55:59.403847 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:55:59.403847 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:55:59.403847 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:55:59.403847 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:55:59.403847 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:55:59.405076 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 15:55:59.405076 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 15:55:59.405076 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 15:55:59.405076 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 15:55:59.405076 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 15:55:59.405076 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 15:55:59.405076 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:55:59.405076 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:55:59.405076 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 415/838] 10.222.0.70 () {56 vars in 1111 bytes} [Fri Aug 19 15:55:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:55:59.409928 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace5000-c153-4331-84cc-6deefd830aa7 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:55:59.511053 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace5000-c153-4331-84cc-6deefd830aa7 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:55:59.527933 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:55:59.544744 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f96f2-b51b-4147-b62c-98605a71200b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:55:59.545346 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f96f2-b51b-4147-b62c-98605a71200b None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:55:59.545626 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f96f2-b51b-4147-b62c-98605a71200b None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:55:59.545899 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f96f2-b51b-4147-b62c-98605a71200b None admin] PATH_INFO: `/v3/projects` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:55:59.546583 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f96f2-b51b-4147-b62c-98605a71200b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:55:59.546886 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f96f2-b51b-4147-b62c-98605a71200b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:55:59.548399 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f96f2-b51b-4147-b62c-98605a71200b None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:55:59.561498 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 424/839] 10.222.0.70 () {56 vars in 1148 bytes} [Fri Aug 19 15:55:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:55:59.567737 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e5bc70-56a8-4eff-ada9-1eb75b725e87 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:55:59.673321 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e5bc70-56a8-4eff-ada9-1eb75b725e87 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:55:59.701985 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:55:59.708188 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd8b28-ab50-4c4f-980c-04f679e4a387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:55:59.708832 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd8b28-ab50-4c4f-980c-04f679e4a387 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:55:59.709113 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd8b28-ab50-4c4f-980c-04f679e4a387 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:55:59.709384 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd8b28-ab50-4c4f-980c-04f679e4a387 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:55:59.710107 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fd8b28-ab50-4c4f-980c-04f679e4a387 None admin] RBAC: Adding query filter params (role.id=f082292a9c404c30891116a86c08becd, scope.project.id=48fb7e21c6864d30b70ffca9093afec8, user.id=580372230aad44269e3e0a7b230533f2) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:55:59.710415 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fd8b28-ab50-4c4f-980c-04f679e4a387 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:55:59.711834 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fd8b28-ab50-4c4f-980c-04f679e4a387 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:55:59.717397 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 416/840] 10.222.0.70 () {56 vars in 1374 bytes} [Fri Aug 19 15:55:59 2022] GET /identity/v3/role_assignments?user.id=580372230aad44269e3e0a7b230533f2&scope.project.id=48fb7e21c6864d30b70ffca9093afec8&role.id=f082292a9c404c30891116a86c08becd => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:56:01.886427 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f30d3-819c-417e-be42-2dba1e3c97a8 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:01.886988 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f30d3-819c-417e-be42-2dba1e3c97a8 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:01.886988 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f30d3-819c-417e-be42-2dba1e3c97a8 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:01.888309 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 425/841] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:56:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:56:01.893614 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e687c-0443-479b-84b8-99af800cfde5 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:01.897768 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e687c-0443-479b-84b8-99af800cfde5 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:01.897768 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e687c-0443-479b-84b8-99af800cfde5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:01.911932 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-5c5e687c-0443-479b-84b8-99af800cfde5 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:56:01.913144 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-5c5e687c-0443-479b-84b8-99af800cfde5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:56:01.979333 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 417/842] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:56:01 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:56:02.309679 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f30d3-819c-417e-be42-2dba1e3c97a8 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:02.413194 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f30d3-819c-417e-be42-2dba1e3c97a8 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:02.449314 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e634780-f29b-4a4a-bf0c-81afd14f96cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:02.449940 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e634780-f29b-4a4a-bf0c-81afd14f96cf None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:02.450212 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e634780-f29b-4a4a-bf0c-81afd14f96cf None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:02.450478 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e634780-f29b-4a4a-bf0c-81afd14f96cf None admin] PATH_INFO: `/v3/roles/service` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:02.460918 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e634780-f29b-4a4a-bf0c-81afd14f96cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:56:02.465791 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-7e634780-f29b-4a4a-bf0c-81afd14f96cf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:56:02.465791 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:56:02.465791 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:56:02.465791 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:56:02.465791 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:56:02.465791 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:56:02.465791 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:56:02.465791 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:56:02.465791 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:56:02.465791 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:56:02.465791 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:56:02.465791 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:56:02.465791 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:56:02.465791 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:56:02.465791 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:56:02.465791 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:56:02.473587 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:56:02.473587 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:56:02.473587 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:56:02.473587 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:56:02.473587 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:56:02.473587 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:56:02.473587 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:56:02.473587 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:56:02.473587 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:56:02.473587 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:56:02.473587 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:56:02.473587 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:56:02.473587 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:56:02.473587 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:56:02.473587 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:56:02.473587 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:56:02.474635 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:56:02.474635 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:56:02.474635 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:56:02.474635 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:56:02.474635 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:56:02.474635 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:56:02.474635 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:56:02.474635 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:56:02.474635 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:56:02.474635 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:56:02.474635 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:56:02.474635 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:56:02.474635 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 426/843] 10.222.0.70 () {56 vars in 1102 bytes} [Fri Aug 19 15:56:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:56:02.475563 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e687c-0443-479b-84b8-99af800cfde5 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:02.576761 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e687c-0443-479b-84b8-99af800cfde5 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:02.602222 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:56:02.613833 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3815a80-e997-49a0-b5fd-9c05ef151306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:02.614434 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3815a80-e997-49a0-b5fd-9c05ef151306 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:02.614708 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3815a80-e997-49a0-b5fd-9c05ef151306 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:02.614976 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3815a80-e997-49a0-b5fd-9c05ef151306 None admin] PATH_INFO: `/v3/roles` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:02.615755 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3815a80-e997-49a0-b5fd-9c05ef151306 None admin] RBAC: Adding query filter params (name=service) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:56:02.616053 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3815a80-e997-49a0-b5fd-9c05ef151306 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:02.617441 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3815a80-e997-49a0-b5fd-9c05ef151306 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:02.625666 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 418/844] 10.222.0.70 () {56 vars in 1103 bytes} [Fri Aug 19 15:56:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:56:02.632240 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e634780-f29b-4a4a-bf0c-81afd14f96cf None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:02.672272 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:56:02.732352 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e634780-f29b-4a4a-bf0c-81afd14f96cf None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:02.765527 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8370096-c485-44fb-b3f7-dab01a510096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:02.766147 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8370096-c485-44fb-b3f7-dab01a510096 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:02.766419 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8370096-c485-44fb-b3f7-dab01a510096 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:02.766685 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8370096-c485-44fb-b3f7-dab01a510096 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:02.777253 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8370096-c485-44fb-b3f7-dab01a510096 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:02.778682 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8370096-c485-44fb-b3f7-dab01a510096 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:02.793523 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-b8370096-c485-44fb-b3f7-dab01a510096 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:56:02.793523 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:56:02.793523 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:56:02.793523 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:56:02.793523 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:56:02.793523 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:56:02.793523 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:56:02.793523 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:56:02.793523 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:56:02.793523 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:56:02.793523 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:56:02.793523 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:56:02.793523 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:56:02.793523 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:56:02.793523 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:56:02.793523 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:56:02.794645 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:56:02.794645 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:56:02.794645 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:56:02.794645 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:56:02.794645 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:56:02.794645 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:56:02.794645 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:56:02.794645 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:56:02.794645 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:56:02.794645 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:56:02.794645 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:56:02.794645 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:56:02.794645 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:56:02.794645 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:56:02.794645 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:56:02.794645 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:56:02.794645 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:56:02.795748 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:56:02.795748 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:56:02.795748 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:56:02.795748 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 427/845] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:56:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:56:02.800652 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3815a80-e997-49a0-b5fd-9c05ef151306 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:02.910055 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3815a80-e997-49a0-b5fd-9c05ef151306 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:02.944593 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99725d7b-dc3c-4a41-910c-737d901bb3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:02.945223 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99725d7b-dc3c-4a41-910c-737d901bb3c1 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:02.945499 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99725d7b-dc3c-4a41-910c-737d901bb3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:02.945770 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99725d7b-dc3c-4a41-910c-737d901bb3c1 None admin] PATH_INFO: `/v3/domains` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:02.946402 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99725d7b-dc3c-4a41-910c-737d901bb3c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:56:02.946705 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99725d7b-dc3c-4a41-910c-737d901bb3c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:02.948874 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99725d7b-dc3c-4a41-910c-737d901bb3c1 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:02.961135 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 419/846] 10.222.0.70 () {56 vars in 1109 bytes} [Fri Aug 19 15:56:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:56:02.967855 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8370096-c485-44fb-b3f7-dab01a510096 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:03.065969 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:56:03.075474 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8370096-c485-44fb-b3f7-dab01a510096 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:03.109232 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344f931-faad-4834-92ab-fcff4d103689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:03.109854 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344f931-faad-4834-92ab-fcff4d103689 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:03.118574 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344f931-faad-4834-92ab-fcff4d103689 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:03.118574 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344f931-faad-4834-92ab-fcff4d103689 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:03.118574 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c344f931-faad-4834-92ab-fcff4d103689 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:03.120208 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c344f931-faad-4834-92ab-fcff4d103689 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:03.131621 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-c344f931-faad-4834-92ab-fcff4d103689 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 15:56:03.131621 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:56:03.131621 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:56:03.131621 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:56:03.131621 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:56:03.131621 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:56:03.131621 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:56:03.131621 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:56:03.131621 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:56:03.131621 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:56:03.131621 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:56:03.131621 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:56:03.131621 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 15:56:03.131621 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 15:56:03.131621 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 15:56:03.131621 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 15:56:03.132797 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:56:03.132797 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:56:03.132797 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 15:56:03.132797 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:56:03.132797 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 15:56:03.132797 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:56:03.132797 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:56:03.132797 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:56:03.132797 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:56:03.132797 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:56:03.132797 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:56:03.132797 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:56:03.132797 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:56:03.132797 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:56:03.132797 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:56:03.132797 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:56:03.132797 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:56:03.132797 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:56:03.133727 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:56:03.133727 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:56:03.133727 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 15:56:03.133727 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 15:56:03.133727 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 15:56:03.133727 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 15:56:03.133727 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 15:56:03.133727 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 15:56:03.133727 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 15:56:03.133727 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:56:03.133727 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 428/847] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:56:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:56:03.138851 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99725d7b-dc3c-4a41-910c-737d901bb3c1 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:03.186851 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:56:03.239536 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99725d7b-dc3c-4a41-910c-737d901bb3c1 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:03.272946 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc81b722-83ad-466e-a6a4-ff87af0319d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:03.273550 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc81b722-83ad-466e-a6a4-ff87af0319d0 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:03.273828 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc81b722-83ad-466e-a6a4-ff87af0319d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:03.274100 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc81b722-83ad-466e-a6a4-ff87af0319d0 None admin] PATH_INFO: `/v3/users` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:03.274816 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc81b722-83ad-466e-a6a4-ff87af0319d0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:56:03.275125 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc81b722-83ad-466e-a6a4-ff87af0319d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:03.276624 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc81b722-83ad-466e-a6a4-ff87af0319d0 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:03.295432 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 420/848] 10.222.0.70 () {56 vars in 1143 bytes} [Fri Aug 19 15:56:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:56:03.301514 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344f931-faad-4834-92ab-fcff4d103689 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:03.403416 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344f931-faad-4834-92ab-fcff4d103689 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:03.437187 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5db507-2dcb-4332-a14a-30d1017222ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:03.437727 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5db507-2dcb-4332-a14a-30d1017222ff None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:03.438001 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5db507-2dcb-4332-a14a-30d1017222ff None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:03.438267 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5db507-2dcb-4332-a14a-30d1017222ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:03.448991 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5db507-2dcb-4332-a14a-30d1017222ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:03.450413 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5db507-2dcb-4332-a14a-30d1017222ff None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:03.464749 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-cc5db507-2dcb-4332-a14a-30d1017222ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:56:03.464749 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:56:03.464749 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:56:03.464749 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:56:03.464749 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:56:03.464749 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:56:03.464749 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:56:03.464749 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:56:03.464749 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:56:03.464749 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:56:03.464749 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:56:03.464749 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:56:03.464749 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:56:03.464749 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:56:03.464749 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:56:03.464749 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:56:03.466307 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:56:03.466307 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:56:03.466307 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:56:03.466307 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:56:03.466307 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:56:03.466307 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:56:03.466307 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:56:03.466307 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:56:03.466307 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:56:03.466307 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:56:03.466307 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:56:03.466307 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:56:03.466307 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:56:03.466307 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:56:03.466307 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:56:03.466307 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:56:03.466307 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:56:03.467381 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:56:03.467381 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:56:03.467381 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:56:03.467381 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 429/849] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:56:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:56:03.474539 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc81b722-83ad-466e-a6a4-ff87af0319d0 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:03.576765 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc81b722-83ad-466e-a6a4-ff87af0319d0 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:03.579103 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:56:03.612072 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e468c5-3a93-4ce3-80ef-a9089be3af85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:03.612696 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e468c5-3a93-4ce3-80ef-a9089be3af85 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:03.612980 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e468c5-3a93-4ce3-80ef-a9089be3af85 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:03.613249 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e468c5-3a93-4ce3-80ef-a9089be3af85 None admin] PATH_INFO: `/v3/domains` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:03.613880 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e468c5-3a93-4ce3-80ef-a9089be3af85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:56:03.614178 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e468c5-3a93-4ce3-80ef-a9089be3af85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:03.615556 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e468c5-3a93-4ce3-80ef-a9089be3af85 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:03.626795 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 421/850] 10.222.0.70 () {56 vars in 1109 bytes} [Fri Aug 19 15:56:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:56:03.632902 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5db507-2dcb-4332-a14a-30d1017222ff None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:03.636061 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:56:03.743511 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5db507-2dcb-4332-a14a-30d1017222ff None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:03.778305 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd265fd2-0aa3-4860-9cca-0cf233ec9817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:03.778933 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd265fd2-0aa3-4860-9cca-0cf233ec9817 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:03.779206 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd265fd2-0aa3-4860-9cca-0cf233ec9817 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:03.779473 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd265fd2-0aa3-4860-9cca-0cf233ec9817 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:03.786248 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd265fd2-0aa3-4860-9cca-0cf233ec9817 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:03.787620 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd265fd2-0aa3-4860-9cca-0cf233ec9817 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:03.798606 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-dd265fd2-0aa3-4860-9cca-0cf233ec9817 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:56:03.798606 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:56:03.798606 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:56:03.798606 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:56:03.798606 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:56:03.798606 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:56:03.798606 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:56:03.798606 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:56:03.798606 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:56:03.798606 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:56:03.798606 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:56:03.798606 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:56:03.798606 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 15:56:03.798606 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 15:56:03.798606 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 15:56:03.799731 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 15:56:03.799731 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:56:03.799731 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:56:03.799731 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:56:03.799731 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:56:03.799731 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:56:03.799731 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:56:03.799731 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:56:03.799731 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:56:03.799731 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:56:03.799731 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:56:03.799731 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:56:03.799731 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:56:03.799731 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:56:03.799731 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:56:03.799731 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:56:03.799731 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:56:03.800630 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 15:56:03.800630 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 15:56:03.800630 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 15:56:03.800630 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 15:56:03.800630 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 15:56:03.800630 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 15:56:03.800630 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:56:03.800630 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:56:03.800630 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 430/851] 10.222.0.70 () {56 vars in 1111 bytes} [Fri Aug 19 15:56:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:56:03.806242 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e468c5-3a93-4ce3-80ef-a9089be3af85 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:03.907890 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e468c5-3a93-4ce3-80ef-a9089be3af85 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:03.942739 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf12c33-4c1f-433a-b427-3aa9e63d4be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:03.943420 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf12c33-4c1f-433a-b427-3aa9e63d4be9 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:03.943606 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf12c33-4c1f-433a-b427-3aa9e63d4be9 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:03.943874 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf12c33-4c1f-433a-b427-3aa9e63d4be9 None admin] PATH_INFO: `/v3/projects` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:03.944559 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf12c33-4c1f-433a-b427-3aa9e63d4be9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:56:03.944889 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf12c33-4c1f-433a-b427-3aa9e63d4be9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:03.946309 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf12c33-4c1f-433a-b427-3aa9e63d4be9 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:03.959151 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 422/852] 10.222.0.70 () {56 vars in 1148 bytes} [Fri Aug 19 15:56:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:56:03.965327 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd265fd2-0aa3-4860-9cca-0cf233ec9817 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:04.028139 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:56:04.068133 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd265fd2-0aa3-4860-9cca-0cf233ec9817 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:04.102833 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86aee62-9937-42fe-b15d-0e5052a6301a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:04.103477 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86aee62-9937-42fe-b15d-0e5052a6301a None admin] REQUEST_METHOD: `PUT` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:04.104471 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86aee62-9937-42fe-b15d-0e5052a6301a None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:04.104777 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86aee62-9937-42fe-b15d-0e5052a6301a None admin] PATH_INFO: `/v3/projects/48fb7e21c6864d30b70ffca9093afec8/users/580372230aad44269e3e0a7b230533f2/roles/f082292a9c404c30891116a86c08becd` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:04.119401 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86aee62-9937-42fe-b15d-0e5052a6301a None admin] RBAC: Authorizing `identity:create_grant(project_id=48fb7e21c6864d30b70ffca9093afec8, user_id=580372230aad44269e3e0a7b230533f2, role_id=f082292a9c404c30891116a86c08becd)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:04.120953 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86aee62-9937-42fe-b15d-0e5052a6301a None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:04.269233 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 431/853] 10.222.0.70 () {58 vars in 1439 bytes} [Fri Aug 19 15:56:03 2022] PUT /identity/v3/projects/48fb7e21c6864d30b70ffca9093afec8/users/580372230aad44269e3e0a7b230533f2/roles/f082292a9c404c30891116a86c08becd => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:56:06.480321 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168422eb-9a75-42e2-9ff1-6c59ff28a55e None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:06.480873 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168422eb-9a75-42e2-9ff1-6c59ff28a55e None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:06.480873 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168422eb-9a75-42e2-9ff1-6c59ff28a55e None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:06.482277 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 423/854] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:56:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:56:06.487528 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5685e4-a6e1-41ce-a083-050221eaf810 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:06.488828 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5685e4-a6e1-41ce-a083-050221eaf810 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:06.488828 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5685e4-a6e1-41ce-a083-050221eaf810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:06.506371 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-ca5685e4-a6e1-41ce-a083-050221eaf810 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:56:06.507561 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-ca5685e4-a6e1-41ce-a083-050221eaf810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:56:06.574233 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 432/855] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:56:06 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:56:06.900986 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168422eb-9a75-42e2-9ff1-6c59ff28a55e None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:06.927563 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:56:07.003357 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168422eb-9a75-42e2-9ff1-6c59ff28a55e None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:07.040008 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e042e-c182-4834-bb97-7e649bed9b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:07.040641 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e042e-c182-4834-bb97-7e649bed9b81 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:07.040946 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e042e-c182-4834-bb97-7e649bed9b81 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:07.041771 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e042e-c182-4834-bb97-7e649bed9b81 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:07.052983 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01e042e-c182-4834-bb97-7e649bed9b81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:56:07.058964 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-d01e042e-c182-4834-bb97-7e649bed9b81 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:56:07.058964 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:56:07.058964 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:56:07.058964 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:56:07.058964 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:56:07.058964 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:56:07.058964 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:56:07.058964 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:56:07.058964 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:56:07.058964 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:56:07.058964 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:56:07.058964 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:56:07.058964 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:56:07.058964 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:56:07.058964 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:56:07.058964 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:56:07.060124 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:56:07.060124 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:56:07.060124 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:56:07.060124 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:56:07.060124 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:56:07.060124 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:56:07.060124 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:56:07.060124 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:56:07.060124 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:56:07.060124 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:56:07.060124 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:56:07.060124 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:56:07.060124 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:56:07.060124 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:56:07.060124 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:56:07.060124 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:56:07.061443 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:56:07.061443 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:56:07.061443 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:56:07.061443 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:56:07.061443 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:56:07.061443 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:56:07.061443 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:56:07.061443 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:56:07.061443 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:56:07.061443 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:56:07.061443 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:56:07.061443 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:56:07.061443 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 424/856] 10.222.0.70 () {56 vars in 1102 bytes} [Fri Aug 19 15:56:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:56:07.066380 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5685e4-a6e1-41ce-a083-050221eaf810 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:07.110615 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:56:07.167863 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5685e4-a6e1-41ce-a083-050221eaf810 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:07.204923 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e689f-2014-43eb-b2f6-d34e89e5a3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:07.205527 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e689f-2014-43eb-b2f6-d34e89e5a3f0 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:07.205796 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e689f-2014-43eb-b2f6-d34e89e5a3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:07.206057 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e689f-2014-43eb-b2f6-d34e89e5a3f0 None admin] PATH_INFO: `/v3/roles` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:07.206712 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e689f-2014-43eb-b2f6-d34e89e5a3f0 None admin] RBAC: Adding query filter params (name=service) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:56:07.207002 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e689f-2014-43eb-b2f6-d34e89e5a3f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:07.208358 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e689f-2014-43eb-b2f6-d34e89e5a3f0 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:07.216609 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 433/857] 10.222.0.70 () {56 vars in 1103 bytes} [Fri Aug 19 15:56:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:56:07.222749 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e042e-c182-4834-bb97-7e649bed9b81 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:07.311130 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:56:07.327302 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e042e-c182-4834-bb97-7e649bed9b81 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:07.361407 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb44dd-9172-47a1-a99a-08b7d24313d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:07.362046 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb44dd-9172-47a1-a99a-08b7d24313d8 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:07.362323 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb44dd-9172-47a1-a99a-08b7d24313d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:07.362595 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb44dd-9172-47a1-a99a-08b7d24313d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:07.373430 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bb44dd-9172-47a1-a99a-08b7d24313d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:07.378909 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bb44dd-9172-47a1-a99a-08b7d24313d8 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:07.390365 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-a5bb44dd-9172-47a1-a99a-08b7d24313d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:56:07.390365 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:56:07.390365 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:56:07.390365 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:56:07.390365 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:56:07.390365 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:56:07.390365 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:56:07.390365 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:56:07.390365 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:56:07.390365 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:56:07.390365 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:56:07.390365 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:56:07.390365 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:56:07.390365 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:56:07.390365 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:56:07.390365 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:56:07.391479 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:56:07.391479 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:56:07.391479 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:56:07.391479 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:56:07.391479 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:56:07.391479 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:56:07.391479 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:56:07.391479 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:56:07.391479 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:56:07.391479 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:56:07.391479 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:56:07.391479 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:56:07.391479 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:56:07.391479 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:56:07.391479 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:56:07.391479 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:56:07.391479 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:56:07.392617 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:56:07.392617 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:56:07.392617 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:56:07.396233 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 425/858] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:56:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:56:07.397476 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e689f-2014-43eb-b2f6-d34e89e5a3f0 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:07.497317 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e689f-2014-43eb-b2f6-d34e89e5a3f0 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:07.519328 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:56:07.533188 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5a50f-fe70-4a60-918d-2083b9b42d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:07.533852 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5a50f-fe70-4a60-918d-2083b9b42d7f None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:07.534128 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5a50f-fe70-4a60-918d-2083b9b42d7f None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:07.534400 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5a50f-fe70-4a60-918d-2083b9b42d7f None admin] PATH_INFO: `/v3/domains` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:07.535036 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5a50f-fe70-4a60-918d-2083b9b42d7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:56:07.535334 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5a50f-fe70-4a60-918d-2083b9b42d7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:07.536709 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5a50f-fe70-4a60-918d-2083b9b42d7f None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:07.550113 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 434/859] 10.222.0.70 () {56 vars in 1109 bytes} [Fri Aug 19 15:56:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:56:07.555800 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb44dd-9172-47a1-a99a-08b7d24313d8 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:07.658098 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb44dd-9172-47a1-a99a-08b7d24313d8 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:07.693596 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e391d5-0e39-4d9c-bcc9-1a5d118b9513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:07.694227 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e391d5-0e39-4d9c-bcc9-1a5d118b9513 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:07.694512 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e391d5-0e39-4d9c-bcc9-1a5d118b9513 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:07.694783 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e391d5-0e39-4d9c-bcc9-1a5d118b9513 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:07.697772 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:56:07.703227 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e391d5-0e39-4d9c-bcc9-1a5d118b9513 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:07.704764 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e391d5-0e39-4d9c-bcc9-1a5d118b9513 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:07.716235 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-b4e391d5-0e39-4d9c-bcc9-1a5d118b9513 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 15:56:07.716235 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:56:07.716235 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:56:07.716235 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:56:07.716235 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:56:07.716235 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:56:07.716235 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:56:07.716235 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:56:07.716235 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:56:07.716235 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:56:07.716235 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:56:07.716235 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:56:07.716235 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 15:56:07.716235 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 15:56:07.716235 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 15:56:07.716235 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 15:56:07.717458 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:56:07.717458 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:56:07.717458 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 15:56:07.717458 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:56:07.717458 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 15:56:07.717458 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:56:07.717458 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:56:07.717458 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:56:07.717458 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:56:07.717458 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:56:07.717458 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:56:07.717458 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:56:07.717458 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:56:07.717458 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:56:07.717458 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:56:07.717458 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:56:07.717458 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:56:07.717458 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:56:07.718488 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:56:07.718488 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:56:07.718488 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 15:56:07.718488 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 15:56:07.718488 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 15:56:07.718488 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 15:56:07.718488 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 15:56:07.718488 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 15:56:07.718488 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 15:56:07.718488 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:56:07.718488 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 426/860] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:56:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:56:07.723438 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5a50f-fe70-4a60-918d-2083b9b42d7f None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:07.826016 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5a50f-fe70-4a60-918d-2083b9b42d7f None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:07.861892 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bdb5d6-c4ca-49a6-b063-9437f32247c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:07.862499 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdb5d6-c4ca-49a6-b063-9437f32247c9 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:07.862774 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdb5d6-c4ca-49a6-b063-9437f32247c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:07.863045 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdb5d6-c4ca-49a6-b063-9437f32247c9 None admin] PATH_INFO: `/v3/users` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:07.863766 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bdb5d6-c4ca-49a6-b063-9437f32247c9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:56:07.864068 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bdb5d6-c4ca-49a6-b063-9437f32247c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:07.865532 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bdb5d6-c4ca-49a6-b063-9437f32247c9 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:07.883391 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 435/861] 10.222.0.70 () {56 vars in 1143 bytes} [Fri Aug 19 15:56:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:56:07.889756 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e391d5-0e39-4d9c-bcc9-1a5d118b9513 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:07.991853 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e391d5-0e39-4d9c-bcc9-1a5d118b9513 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:08.026484 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9009d9-f2a2-4e87-94de-6185e1a43cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:08.027094 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9009d9-f2a2-4e87-94de-6185e1a43cb9 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:08.027372 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9009d9-f2a2-4e87-94de-6185e1a43cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:08.027643 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9009d9-f2a2-4e87-94de-6185e1a43cb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:08.092214 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:56:08.098836 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9009d9-f2a2-4e87-94de-6185e1a43cb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:08.100298 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9009d9-f2a2-4e87-94de-6185e1a43cb9 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:08.200969 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 427/862] 10.222.0.70 () {58 vars in 1282 bytes} [Fri Aug 19 15:56:07 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 15:56:08.206850 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bdb5d6-c4ca-49a6-b063-9437f32247c9 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:08.232124 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:56:08.310987 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bdb5d6-c4ca-49a6-b063-9437f32247c9 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:08.344754 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4ed212-007c-4910-b7a7-ac4b0b1b3787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:08.345318 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ed212-007c-4910-b7a7-ac4b0b1b3787 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:08.345589 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ed212-007c-4910-b7a7-ac4b0b1b3787 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:08.345859 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ed212-007c-4910-b7a7-ac4b0b1b3787 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:08.357815 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4ed212-007c-4910-b7a7-ac4b0b1b3787 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:08.359230 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4ed212-007c-4910-b7a7-ac4b0b1b3787 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:08.375242 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-bb4ed212-007c-4910-b7a7-ac4b0b1b3787 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:56:08.375242 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:56:08.375242 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:56:08.375242 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:56:08.375242 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:56:08.375242 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:56:08.375242 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:56:08.375242 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:56:08.375242 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:56:08.375242 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:56:08.375242 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:56:08.375242 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:56:08.375242 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:56:08.375242 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:56:08.375242 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:56:08.375242 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:56:08.376437 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:56:08.376437 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:56:08.376437 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:56:08.376437 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:56:08.376437 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:56:08.376437 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:56:08.376437 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:56:08.376437 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:56:08.376437 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:56:08.376437 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:56:08.376437 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:56:08.376437 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:56:08.376437 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:56:08.376437 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:56:08.376437 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:56:08.376437 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:56:08.376437 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:56:08.377820 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:56:08.377820 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:56:08.377820 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:56:08.377820 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 436/863] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:56:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:56:08.382516 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9009d9-f2a2-4e87-94de-6185e1a43cb9 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:08.485544 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:56:08.491945 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9009d9-f2a2-4e87-94de-6185e1a43cb9 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:08.533295 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88728aca-d94b-45d0-a917-da22522a80b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:08.533902 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88728aca-d94b-45d0-a917-da22522a80b5 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:08.534177 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88728aca-d94b-45d0-a917-da22522a80b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:08.534443 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88728aca-d94b-45d0-a917-da22522a80b5 None admin] PATH_INFO: `/v3/domains` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:08.535079 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88728aca-d94b-45d0-a917-da22522a80b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:56:08.535377 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88728aca-d94b-45d0-a917-da22522a80b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:08.536760 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88728aca-d94b-45d0-a917-da22522a80b5 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:08.549240 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 428/864] 10.222.0.70 () {56 vars in 1109 bytes} [Fri Aug 19 15:56:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:56:08.555060 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4ed212-007c-4910-b7a7-ac4b0b1b3787 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:08.630460 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:56:08.655038 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4ed212-007c-4910-b7a7-ac4b0b1b3787 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:08.689191 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b1900-03bb-4f7c-9397-1ec53594b9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:08.689819 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b1900-03bb-4f7c-9397-1ec53594b9aa None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:08.690097 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b1900-03bb-4f7c-9397-1ec53594b9aa None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:08.690400 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b1900-03bb-4f7c-9397-1ec53594b9aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:08.697303 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b1900-03bb-4f7c-9397-1ec53594b9aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:08.698872 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b1900-03bb-4f7c-9397-1ec53594b9aa None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:08.710080 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-007b1900-03bb-4f7c-9397-1ec53594b9aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:56:08.710080 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:56:08.710080 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:56:08.710080 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:56:08.710080 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:56:08.710080 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:56:08.710080 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:56:08.710080 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:56:08.710080 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:56:08.710080 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:56:08.710080 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:56:08.710080 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:56:08.710080 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 15:56:08.710080 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 15:56:08.710080 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 15:56:08.715118 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 15:56:08.715118 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:56:08.715118 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:56:08.715118 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:56:08.715118 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:56:08.715118 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:56:08.715118 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:56:08.715118 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:56:08.715118 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:56:08.715118 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:56:08.715118 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:56:08.715118 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:56:08.715118 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:56:08.715118 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:56:08.715118 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:56:08.715118 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:56:08.715118 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:56:08.716251 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 15:56:08.716251 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 15:56:08.716251 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 15:56:08.716251 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 15:56:08.716251 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 15:56:08.716251 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 15:56:08.716251 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:56:08.716251 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:56:08.716251 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 437/865] 10.222.0.70 () {56 vars in 1111 bytes} [Fri Aug 19 15:56:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:56:08.717907 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88728aca-d94b-45d0-a917-da22522a80b5 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:08.824420 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88728aca-d94b-45d0-a917-da22522a80b5 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:08.861865 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e331f03-f472-499b-88e3-17f9b3615061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:08.862476 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e331f03-f472-499b-88e3-17f9b3615061 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:08.862755 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e331f03-f472-499b-88e3-17f9b3615061 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:08.863027 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e331f03-f472-499b-88e3-17f9b3615061 None admin] PATH_INFO: `/v3/projects` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:08.863713 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e331f03-f472-499b-88e3-17f9b3615061 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:56:08.864017 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e331f03-f472-499b-88e3-17f9b3615061 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:08.865492 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e331f03-f472-499b-88e3-17f9b3615061 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:08.878073 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 429/866] 10.222.0.70 () {56 vars in 1148 bytes} [Fri Aug 19 15:56:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:56:08.889759 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b1900-03bb-4f7c-9397-1ec53594b9aa None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:08.992206 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b1900-03bb-4f7c-9397-1ec53594b9aa None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:09.027313 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac1f9fb-651b-4eb3-a05f-2ebcafc84c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:09.027901 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1f9fb-651b-4eb3-a05f-2ebcafc84c53 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:09.028174 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1f9fb-651b-4eb3-a05f-2ebcafc84c53 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:09.028442 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1f9fb-651b-4eb3-a05f-2ebcafc84c53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:09.029184 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac1f9fb-651b-4eb3-a05f-2ebcafc84c53 None admin] RBAC: Adding query filter params (role.id=f082292a9c404c30891116a86c08becd, scope.project.id=48fb7e21c6864d30b70ffca9093afec8, user.id=580372230aad44269e3e0a7b230533f2) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:56:09.029486 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac1f9fb-651b-4eb3-a05f-2ebcafc84c53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:09.030897 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac1f9fb-651b-4eb3-a05f-2ebcafc84c53 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:09.032620 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:56:09.036951 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 438/867] 10.222.0.70 () {56 vars in 1374 bytes} [Fri Aug 19 15:56:08 2022] GET /identity/v3/role_assignments?user.id=580372230aad44269e3e0a7b230533f2&scope.project.id=48fb7e21c6864d30b70ffca9093afec8&role.id=f082292a9c404c30891116a86c08becd => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:56:11.327501 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff8e68-d3bd-4b78-abdb-33ebf44f1ba4 None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:11.328030 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff8e68-d3bd-4b78-abdb-33ebf44f1ba4 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:11.328030 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff8e68-d3bd-4b78-abdb-33ebf44f1ba4 None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:11.329399 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 430/868] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:56:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:56:11.334624 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691515e-80a1-4a68-b654-1ef7de39862f None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:11.335062 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691515e-80a1-4a68-b654-1ef7de39862f None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:11.335199 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691515e-80a1-4a68-b654-1ef7de39862f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:11.354742 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-e691515e-80a1-4a68-b654-1ef7de39862f None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:56:11.355935 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-e691515e-80a1-4a68-b654-1ef7de39862f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:56:11.424377 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 439/869] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:56:11 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:56:11.755118 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff8e68-d3bd-4b78-abdb-33ebf44f1ba4 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:11.773818 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:56:11.857113 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff8e68-d3bd-4b78-abdb-33ebf44f1ba4 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:11.892776 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6813f627-c922-40f5-b6ba-b456d8349795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:11.893558 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813f627-c922-40f5-b6ba-b456d8349795 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:11.893833 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813f627-c922-40f5-b6ba-b456d8349795 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:11.894103 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813f627-c922-40f5-b6ba-b456d8349795 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:11.904109 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6813f627-c922-40f5-b6ba-b456d8349795 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:56:11.908834 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-6813f627-c922-40f5-b6ba-b456d8349795 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:56:11.908834 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:56:11.908834 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:56:11.908834 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:56:11.908834 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:56:11.908834 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:56:11.908834 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:56:11.908834 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:56:11.908834 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:56:11.908834 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:56:11.908834 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:56:11.908834 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:56:11.908834 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:56:11.908834 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:56:11.908834 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:56:11.908834 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:56:11.915466 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:56:11.915466 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:56:11.915466 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:56:11.915466 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:56:11.915466 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:56:11.915466 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:56:11.915466 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:56:11.915466 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:56:11.915466 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:56:11.915466 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:56:11.915466 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:56:11.915466 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:56:11.915466 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:56:11.915466 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:56:11.915466 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:56:11.915466 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:56:11.916403 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:56:11.916403 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:56:11.916403 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:56:11.916403 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:56:11.916403 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:56:11.916403 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:56:11.916403 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:56:11.916403 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:56:11.916403 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:56:11.916403 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:56:11.916403 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:56:11.916403 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:56:11.916403 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 431/870] 10.222.0.70 () {56 vars in 1096 bytes} [Fri Aug 19 15:56:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:56:11.917127 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691515e-80a1-4a68-b654-1ef7de39862f None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:12.015444 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691515e-80a1-4a68-b654-1ef7de39862f None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:12.042682 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:56:12.050568 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a2f0c-5ec3-4926-a2f0-aa1c940faf7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:12.051171 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a2f0c-5ec3-4926-a2f0-aa1c940faf7b None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:12.051448 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a2f0c-5ec3-4926-a2f0-aa1c940faf7b None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:12.051720 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a2f0c-5ec3-4926-a2f0-aa1c940faf7b None admin] PATH_INFO: `/v3/roles` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:12.052433 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70a2f0c-5ec3-4926-a2f0-aa1c940faf7b None admin] RBAC: Adding query filter params (name=admin) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:56:12.052837 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70a2f0c-5ec3-4926-a2f0-aa1c940faf7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:12.054210 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70a2f0c-5ec3-4926-a2f0-aa1c940faf7b None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:12.062895 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 440/871] 10.222.0.70 () {56 vars in 1099 bytes} [Fri Aug 19 15:56:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:56:12.068919 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6813f627-c922-40f5-b6ba-b456d8349795 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:12.149642 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:56:12.172947 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6813f627-c922-40f5-b6ba-b456d8349795 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:12.207884 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ba7aec-0638-458e-9bbe-f6a371a1eaf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:12.208513 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba7aec-0638-458e-9bbe-f6a371a1eaf7 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:12.208826 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba7aec-0638-458e-9bbe-f6a371a1eaf7 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:12.209100 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba7aec-0638-458e-9bbe-f6a371a1eaf7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:12.219471 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ba7aec-0638-458e-9bbe-f6a371a1eaf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:12.221004 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ba7aec-0638-458e-9bbe-f6a371a1eaf7 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:12.236491 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-d2ba7aec-0638-458e-9bbe-f6a371a1eaf7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:56:12.236491 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:56:12.236491 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:56:12.236491 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:56:12.236491 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:56:12.236491 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:56:12.236491 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:56:12.236491 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:56:12.236491 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:56:12.236491 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:56:12.236491 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:56:12.236491 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:56:12.236491 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:56:12.236491 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:56:12.236491 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:56:12.236491 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:56:12.237635 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:56:12.237635 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:56:12.237635 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:56:12.237635 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:56:12.237635 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:56:12.237635 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:56:12.237635 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:56:12.237635 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:56:12.237635 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:56:12.237635 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:56:12.237635 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:56:12.237635 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:56:12.237635 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:56:12.237635 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:56:12.237635 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:56:12.237635 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:56:12.237635 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:56:12.238514 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:56:12.238514 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:56:12.238514 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:56:12.238514 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 432/872] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:56:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:56:12.243676 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a2f0c-5ec3-4926-a2f0-aa1c940faf7b None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:12.342392 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a2f0c-5ec3-4926-a2f0-aa1c940faf7b None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:12.376445 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9350078c-ad84-413e-a474-b7be5a6a84ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:12.377344 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350078c-ad84-413e-a474-b7be5a6a84ed None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:12.377619 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350078c-ad84-413e-a474-b7be5a6a84ed None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:12.377888 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350078c-ad84-413e-a474-b7be5a6a84ed None admin] PATH_INFO: `/v3/domains` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:12.378521 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9350078c-ad84-413e-a474-b7be5a6a84ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:56:12.378820 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9350078c-ad84-413e-a474-b7be5a6a84ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:12.380178 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9350078c-ad84-413e-a474-b7be5a6a84ed None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:12.392677 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 441/873] 10.222.0.70 () {56 vars in 1109 bytes} [Fri Aug 19 15:56:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:56:12.398524 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ba7aec-0638-458e-9bbe-f6a371a1eaf7 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:12.501477 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ba7aec-0638-458e-9bbe-f6a371a1eaf7 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:12.528165 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:56:12.535911 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc5829-a0f0-4d3f-83fd-165fc713defd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:12.536537 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc5829-a0f0-4d3f-83fd-165fc713defd None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:12.536841 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc5829-a0f0-4d3f-83fd-165fc713defd None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:12.537111 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc5829-a0f0-4d3f-83fd-165fc713defd None admin] PATH_INFO: `/v3/users/placement` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:12.546453 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdc5829-a0f0-4d3f-83fd-165fc713defd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:12.547880 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdc5829-a0f0-4d3f-83fd-165fc713defd None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:12.559436 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-9bdc5829-a0f0-4d3f-83fd-165fc713defd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 15:56:12.559436 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:56:12.559436 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:56:12.559436 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:56:12.559436 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:56:12.559436 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:56:12.559436 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:56:12.559436 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:56:12.559436 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:56:12.559436 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:56:12.559436 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:56:12.559436 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:56:12.559436 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 15:56:12.559436 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 15:56:12.559436 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 15:56:12.559436 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 15:56:12.562809 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:56:12.562809 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:56:12.562809 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 15:56:12.562809 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:56:12.562809 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 15:56:12.562809 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:56:12.562809 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:56:12.562809 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:56:12.562809 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:56:12.562809 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:56:12.562809 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:56:12.562809 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:56:12.562809 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:56:12.562809 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:56:12.562809 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:56:12.562809 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:56:12.562809 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:56:12.562809 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:56:12.563940 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:56:12.563940 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:56:12.563940 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 15:56:12.563940 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 15:56:12.563940 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 15:56:12.563940 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 15:56:12.563940 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 15:56:12.563940 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 15:56:12.563940 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 15:56:12.563940 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:56:12.563940 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 433/874] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:56:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:56:12.566728 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9350078c-ad84-413e-a474-b7be5a6a84ed None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:12.617093 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:56:12.667116 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9350078c-ad84-413e-a474-b7be5a6a84ed None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:12.701330 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00598c0b-ba87-48e4-b613-7bdbdb064495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:12.701939 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00598c0b-ba87-48e4-b613-7bdbdb064495 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:12.702246 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00598c0b-ba87-48e4-b613-7bdbdb064495 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:12.702519 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00598c0b-ba87-48e4-b613-7bdbdb064495 None admin] PATH_INFO: `/v3/users` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:12.703818 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00598c0b-ba87-48e4-b613-7bdbdb064495 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:56:12.704124 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00598c0b-ba87-48e4-b613-7bdbdb064495 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:12.705583 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00598c0b-ba87-48e4-b613-7bdbdb064495 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:12.723185 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 442/875] 10.222.0.70 () {56 vars in 1143 bytes} [Fri Aug 19 15:56:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:56:12.729209 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc5829-a0f0-4d3f-83fd-165fc713defd None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:12.829907 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc5829-a0f0-4d3f-83fd-165fc713defd None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:12.864107 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f205a1-3bbb-47d4-ae46-db7475fbf83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:12.864731 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f205a1-3bbb-47d4-ae46-db7475fbf83f None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:12.865014 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f205a1-3bbb-47d4-ae46-db7475fbf83f None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:12.865288 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f205a1-3bbb-47d4-ae46-db7475fbf83f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:12.922164 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:56:12.934464 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f205a1-3bbb-47d4-ae46-db7475fbf83f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:12.935920 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f205a1-3bbb-47d4-ae46-db7475fbf83f None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:13.033475 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 434/876] 10.222.0.70 () {58 vars in 1282 bytes} [Fri Aug 19 15:56:12 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 15:56:13.039314 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00598c0b-ba87-48e4-b613-7bdbdb064495 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:13.139445 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00598c0b-ba87-48e4-b613-7bdbdb064495 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:13.148678 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:56:13.174351 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848bc7dd-1f1d-4b08-873a-c8ea4fae53d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:13.174905 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bc7dd-1f1d-4b08-873a-c8ea4fae53d5 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:13.175174 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bc7dd-1f1d-4b08-873a-c8ea4fae53d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:13.175436 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bc7dd-1f1d-4b08-873a-c8ea4fae53d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:13.185399 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848bc7dd-1f1d-4b08-873a-c8ea4fae53d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:13.186828 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848bc7dd-1f1d-4b08-873a-c8ea4fae53d5 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:13.201983 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-848bc7dd-1f1d-4b08-873a-c8ea4fae53d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:56:13.201983 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:56:13.201983 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:56:13.201983 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:56:13.201983 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:56:13.201983 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:56:13.201983 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:56:13.201983 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:56:13.201983 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:56:13.201983 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:56:13.201983 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:56:13.201983 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:56:13.201983 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:56:13.201983 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:56:13.201983 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:56:13.201983 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:56:13.203113 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:56:13.203113 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:56:13.203113 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:56:13.203113 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:56:13.203113 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:56:13.203113 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:56:13.203113 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:56:13.203113 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:56:13.203113 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:56:13.203113 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:56:13.203113 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:56:13.203113 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:56:13.203113 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:56:13.203113 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:56:13.203113 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:56:13.203113 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:56:13.203113 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:56:13.204056 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:56:13.204056 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:56:13.204056 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:56:13.204056 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 443/877] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:56:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:56:13.208910 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f205a1-3bbb-47d4-ae46-db7475fbf83f None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:13.296027 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:56:13.307958 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f205a1-3bbb-47d4-ae46-db7475fbf83f None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:13.341234 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800335cb-8746-4034-8462-62e373d0fbb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:13.341829 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800335cb-8746-4034-8462-62e373d0fbb4 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:13.342101 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800335cb-8746-4034-8462-62e373d0fbb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:13.342396 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800335cb-8746-4034-8462-62e373d0fbb4 None admin] PATH_INFO: `/v3/domains` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:13.343020 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800335cb-8746-4034-8462-62e373d0fbb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:56:13.343315 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800335cb-8746-4034-8462-62e373d0fbb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:13.344729 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800335cb-8746-4034-8462-62e373d0fbb4 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:13.356999 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 435/878] 10.222.0.70 () {56 vars in 1109 bytes} [Fri Aug 19 15:56:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:56:13.362792 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848bc7dd-1f1d-4b08-873a-c8ea4fae53d5 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:13.469680 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848bc7dd-1f1d-4b08-873a-c8ea4fae53d5 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:13.503409 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed3806-4c7b-49f8-9b2b-d2540c3c92b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:13.504035 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed3806-4c7b-49f8-9b2b-d2540c3c92b5 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:13.504314 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed3806-4c7b-49f8-9b2b-d2540c3c92b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:13.504585 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed3806-4c7b-49f8-9b2b-d2540c3c92b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:13.511996 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bed3806-4c7b-49f8-9b2b-d2540c3c92b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:13.513515 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bed3806-4c7b-49f8-9b2b-d2540c3c92b5 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:13.524298 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-5bed3806-4c7b-49f8-9b2b-d2540c3c92b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:56:13.524298 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:56:13.524298 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:56:13.524298 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:56:13.524298 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:56:13.524298 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:56:13.524298 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:56:13.524298 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:56:13.524298 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:56:13.524298 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:56:13.524298 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:56:13.524298 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:56:13.524298 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 15:56:13.524298 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 15:56:13.524298 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 15:56:13.525978 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 15:56:13.525978 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:56:13.525978 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:56:13.525978 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:56:13.525978 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:56:13.525978 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:56:13.525978 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:56:13.525978 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:56:13.525978 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:56:13.525978 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:56:13.525978 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:56:13.525978 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:56:13.525978 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:56:13.525978 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:56:13.525978 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:56:13.525978 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:56:13.525978 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:56:13.526923 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 15:56:13.526923 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 15:56:13.526923 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 15:56:13.526923 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 15:56:13.526923 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 15:56:13.526923 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 15:56:13.526923 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:56:13.526923 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:56:13.526923 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 444/879] 10.222.0.70 () {56 vars in 1111 bytes} [Fri Aug 19 15:56:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:56:13.532025 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800335cb-8746-4034-8462-62e373d0fbb4 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:13.645308 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800335cb-8746-4034-8462-62e373d0fbb4 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:13.687793 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2286c-0105-4b55-a5d0-579fde1663a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:13.688413 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2286c-0105-4b55-a5d0-579fde1663a4 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:13.688717 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2286c-0105-4b55-a5d0-579fde1663a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:13.688993 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2286c-0105-4b55-a5d0-579fde1663a4 None admin] PATH_INFO: `/v3/projects` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:13.689884 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa2286c-0105-4b55-a5d0-579fde1663a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:56:13.690192 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa2286c-0105-4b55-a5d0-579fde1663a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:13.691666 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa2286c-0105-4b55-a5d0-579fde1663a4 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:13.705866 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 436/880] 10.222.0.70 () {56 vars in 1148 bytes} [Fri Aug 19 15:56:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:56:13.713513 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed3806-4c7b-49f8-9b2b-d2540c3c92b5 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:13.737223 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:56:13.833407 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed3806-4c7b-49f8-9b2b-d2540c3c92b5 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:13.873097 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd9c56-6587-46c9-b49c-817591394ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:13.874062 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd9c56-6587-46c9-b49c-817591394ea7 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:13.874518 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd9c56-6587-46c9-b49c-817591394ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:13.874976 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd9c56-6587-46c9-b49c-817591394ea7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:13.877316 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cd9c56-6587-46c9-b49c-817591394ea7 None admin] RBAC: Adding query filter params (role.id=2f6cb7d6ec874879972a12a63d61068d, scope.project.id=48fb7e21c6864d30b70ffca9093afec8, user.id=580372230aad44269e3e0a7b230533f2) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:56:13.877316 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cd9c56-6587-46c9-b49c-817591394ea7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:13.879284 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cd9c56-6587-46c9-b49c-817591394ea7 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:13.885798 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 445/881] 10.222.0.70 () {56 vars in 1374 bytes} [Fri Aug 19 15:56:13 2022] GET /identity/v3/role_assignments?user.id=580372230aad44269e3e0a7b230533f2&scope.project.id=48fb7e21c6864d30b70ffca9093afec8&role.id=2f6cb7d6ec874879972a12a63d61068d => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:56:16.153272 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72650ac1-7f49-4c7f-bc8c-8add4695cd8f None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:16.153815 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72650ac1-7f49-4c7f-bc8c-8add4695cd8f None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:16.153815 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72650ac1-7f49-4c7f-bc8c-8add4695cd8f None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:16.154935 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 437/882] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:56:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:56:16.160722 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12779c-4260-4422-8914-8899ba099187 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:16.161176 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12779c-4260-4422-8914-8899ba099187 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:16.161264 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12779c-4260-4422-8914-8899ba099187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:16.179244 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-7c12779c-4260-4422-8914-8899ba099187 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:56:16.180433 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-7c12779c-4260-4422-8914-8899ba099187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:56:16.246599 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 446/883] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:56:16 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:56:16.588847 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72650ac1-7f49-4c7f-bc8c-8add4695cd8f None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:16.599968 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:56:16.690069 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72650ac1-7f49-4c7f-bc8c-8add4695cd8f None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:16.726154 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a347b330-6dac-4e23-aa61-0b2dff73ccc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:16.726779 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347b330-6dac-4e23-aa61-0b2dff73ccc3 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:16.727048 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347b330-6dac-4e23-aa61-0b2dff73ccc3 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:16.727313 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347b330-6dac-4e23-aa61-0b2dff73ccc3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:16.737368 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a347b330-6dac-4e23-aa61-0b2dff73ccc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:56:16.741971 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-a347b330-6dac-4e23-aa61-0b2dff73ccc3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:56:16.741971 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:56:16.741971 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:56:16.741971 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:56:16.741971 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:56:16.741971 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:56:16.741971 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:56:16.741971 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:56:16.741971 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:56:16.741971 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:56:16.741971 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:56:16.741971 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:56:16.741971 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:56:16.741971 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:56:16.741971 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:56:16.741971 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:56:16.751497 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:56:16.751497 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:56:16.751497 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:56:16.751497 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:56:16.751497 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:56:16.751497 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:56:16.751497 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:56:16.751497 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:56:16.751497 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:56:16.751497 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:56:16.751497 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:56:16.751497 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:56:16.751497 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:56:16.751497 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:56:16.751497 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:56:16.751497 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:56:16.752652 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:56:16.752652 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:56:16.752652 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:56:16.752652 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:56:16.752652 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:56:16.752652 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:56:16.752652 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:56:16.752652 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:56:16.752652 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:56:16.752652 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:56:16.752652 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:56:16.752652 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:56:16.752652 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 438/884] 10.222.0.70 () {56 vars in 1096 bytes} [Fri Aug 19 15:56:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:56:16.753404 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c12779c-4260-4422-8914-8899ba099187 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:16.764608 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:56:16.848260 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c12779c-4260-4422-8914-8899ba099187 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:16.881524 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b98485-e726-4b3f-8fc8-9bad412ec95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:16.882117 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b98485-e726-4b3f-8fc8-9bad412ec95b None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:16.882389 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b98485-e726-4b3f-8fc8-9bad412ec95b None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:16.882656 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b98485-e726-4b3f-8fc8-9bad412ec95b None admin] PATH_INFO: `/v3/roles` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:16.883301 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b98485-e726-4b3f-8fc8-9bad412ec95b None admin] RBAC: Adding query filter params (name=admin) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:56:16.883597 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b98485-e726-4b3f-8fc8-9bad412ec95b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:16.885599 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b98485-e726-4b3f-8fc8-9bad412ec95b None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:16.893472 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 447/885] 10.222.0.70 () {56 vars in 1099 bytes} [Fri Aug 19 15:56:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:56:16.899330 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a347b330-6dac-4e23-aa61-0b2dff73ccc3 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:16.966329 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:56:16.999163 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a347b330-6dac-4e23-aa61-0b2dff73ccc3 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:17.031824 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970c7d70-b22d-4b7a-a546-8e95ffdd2523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:17.035204 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c7d70-b22d-4b7a-a546-8e95ffdd2523 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:17.035204 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c7d70-b22d-4b7a-a546-8e95ffdd2523 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:17.035204 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c7d70-b22d-4b7a-a546-8e95ffdd2523 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:17.043168 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970c7d70-b22d-4b7a-a546-8e95ffdd2523 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:17.044589 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970c7d70-b22d-4b7a-a546-8e95ffdd2523 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:17.058679 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-970c7d70-b22d-4b7a-a546-8e95ffdd2523 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:56:17.058679 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:56:17.058679 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:56:17.058679 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:56:17.058679 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:56:17.058679 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:56:17.058679 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:56:17.058679 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:56:17.058679 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:56:17.058679 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:56:17.058679 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:56:17.058679 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:56:17.058679 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:56:17.058679 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:56:17.058679 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:56:17.058679 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:56:17.064581 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:56:17.064581 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:56:17.064581 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:56:17.064581 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:56:17.064581 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:56:17.064581 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:56:17.064581 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:56:17.064581 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:56:17.064581 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:56:17.064581 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:56:17.064581 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:56:17.064581 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:56:17.064581 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:56:17.064581 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:56:17.064581 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:56:17.064581 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:56:17.064581 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:56:17.065707 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:56:17.065707 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:56:17.065707 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:56:17.065707 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 439/886] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:56:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:56:17.065933 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b98485-e726-4b3f-8fc8-9bad412ec95b None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:17.143532 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:56:17.166006 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b98485-e726-4b3f-8fc8-9bad412ec95b None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:17.199172 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ebcfa-3b15-4f83-ae8e-53ddb9552ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:17.199769 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ebcfa-3b15-4f83-ae8e-53ddb9552ce1 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:17.200045 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ebcfa-3b15-4f83-ae8e-53ddb9552ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:17.200316 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ebcfa-3b15-4f83-ae8e-53ddb9552ce1 None admin] PATH_INFO: `/v3/domains` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:17.201021 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9ebcfa-3b15-4f83-ae8e-53ddb9552ce1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:56:17.201321 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9ebcfa-3b15-4f83-ae8e-53ddb9552ce1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:17.202678 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9ebcfa-3b15-4f83-ae8e-53ddb9552ce1 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:17.215428 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 448/887] 10.222.0.70 () {56 vars in 1109 bytes} [Fri Aug 19 15:56:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:56:17.221379 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970c7d70-b22d-4b7a-a546-8e95ffdd2523 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:17.325396 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970c7d70-b22d-4b7a-a546-8e95ffdd2523 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:17.345266 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:56:17.359693 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e19f9-2d24-4bd6-8457-55177a36103a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:17.360322 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e19f9-2d24-4bd6-8457-55177a36103a None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:17.360600 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e19f9-2d24-4bd6-8457-55177a36103a None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:17.360905 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e19f9-2d24-4bd6-8457-55177a36103a None admin] PATH_INFO: `/v3/users/placement` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:17.368381 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17e19f9-2d24-4bd6-8457-55177a36103a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:17.370650 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17e19f9-2d24-4bd6-8457-55177a36103a None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:17.382489 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-b17e19f9-2d24-4bd6-8457-55177a36103a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 15:56:17.382489 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:56:17.382489 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:56:17.382489 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:56:17.382489 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:56:17.382489 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:56:17.382489 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:56:17.382489 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:56:17.382489 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:56:17.382489 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:56:17.382489 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:56:17.382489 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:56:17.382489 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 15:56:17.382489 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 15:56:17.382489 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 15:56:17.382489 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 15:56:17.383633 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:56:17.383633 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:56:17.383633 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 15:56:17.383633 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:56:17.383633 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 15:56:17.383633 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:56:17.383633 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:56:17.383633 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:56:17.383633 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:56:17.383633 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:56:17.383633 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:56:17.383633 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:56:17.383633 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:56:17.383633 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:56:17.383633 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:56:17.383633 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:56:17.383633 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:56:17.383633 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:56:17.384639 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:56:17.384639 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:56:17.384639 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 15:56:17.384639 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 15:56:17.384639 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 15:56:17.384639 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 15:56:17.384639 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 15:56:17.384639 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 15:56:17.384639 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 15:56:17.384639 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:56:17.384639 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 440/888] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:56:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:56:17.391989 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ebcfa-3b15-4f83-ae8e-53ddb9552ce1 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:17.488581 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ebcfa-3b15-4f83-ae8e-53ddb9552ce1 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:17.522468 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9356ee2-4f5a-4428-9573-ce9933c89302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:17.523069 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9356ee2-4f5a-4428-9573-ce9933c89302 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:17.523340 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9356ee2-4f5a-4428-9573-ce9933c89302 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:17.523606 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9356ee2-4f5a-4428-9573-ce9933c89302 None admin] PATH_INFO: `/v3/users` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:17.524327 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9356ee2-4f5a-4428-9573-ce9933c89302 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:56:17.524626 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9356ee2-4f5a-4428-9573-ce9933c89302 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:17.526536 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9356ee2-4f5a-4428-9573-ce9933c89302 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:17.529296 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:56:17.544565 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 449/889] 10.222.0.70 () {56 vars in 1143 bytes} [Fri Aug 19 15:56:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:56:17.550445 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e19f9-2d24-4bd6-8457-55177a36103a None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:17.657054 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e19f9-2d24-4bd6-8457-55177a36103a None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:17.692184 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026dea6-b47a-4776-baa9-60b72d790dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:17.692883 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026dea6-b47a-4776-baa9-60b72d790dec None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:17.693247 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026dea6-b47a-4776-baa9-60b72d790dec None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:17.693526 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026dea6-b47a-4776-baa9-60b72d790dec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:17.707320 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026dea6-b47a-4776-baa9-60b72d790dec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:17.709271 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026dea6-b47a-4776-baa9-60b72d790dec None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:17.726271 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-f026dea6-b47a-4776-baa9-60b72d790dec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:56:17.726271 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:56:17.726271 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:56:17.726271 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:56:17.726271 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:56:17.726271 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:56:17.726271 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:56:17.726271 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:56:17.726271 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:56:17.726271 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:56:17.726271 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:56:17.726271 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:56:17.726271 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:56:17.726271 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:56:17.726271 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:56:17.726271 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:56:17.727355 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:56:17.727355 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:56:17.727355 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:56:17.727355 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:56:17.727355 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:56:17.727355 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:56:17.727355 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:56:17.727355 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:56:17.727355 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:56:17.727355 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:56:17.727355 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:56:17.727355 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:56:17.727355 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:56:17.727355 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:56:17.727355 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:56:17.727355 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:56:17.727355 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:56:17.728337 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:56:17.728337 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:56:17.728337 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:56:17.728337 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 441/890] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:56:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:56:17.734019 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9356ee2-4f5a-4428-9573-ce9933c89302 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:17.842054 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9356ee2-4f5a-4428-9573-ce9933c89302 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:17.881168 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc48eb-e196-46b2-9ea4-d7df10a89d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:17.881799 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc48eb-e196-46b2-9ea4-d7df10a89d7a None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:17.882076 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc48eb-e196-46b2-9ea4-d7df10a89d7a None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:17.882347 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc48eb-e196-46b2-9ea4-d7df10a89d7a None admin] PATH_INFO: `/v3/domains` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:17.883091 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc48eb-e196-46b2-9ea4-d7df10a89d7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:56:17.883394 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc48eb-e196-46b2-9ea4-d7df10a89d7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:17.885050 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc48eb-e196-46b2-9ea4-d7df10a89d7a None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:17.896775 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 450/891] 10.222.0.70 () {56 vars in 1109 bytes} [Fri Aug 19 15:56:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:56:17.903221 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026dea6-b47a-4776-baa9-60b72d790dec None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:17.939084 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:56:18.011370 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026dea6-b47a-4776-baa9-60b72d790dec None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:18.045888 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68028d3-342b-4a06-945a-a032fff6c6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:18.046516 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68028d3-342b-4a06-945a-a032fff6c6f3 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:18.046790 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68028d3-342b-4a06-945a-a032fff6c6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:18.047057 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68028d3-342b-4a06-945a-a032fff6c6f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:18.053812 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68028d3-342b-4a06-945a-a032fff6c6f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:18.055247 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68028d3-342b-4a06-945a-a032fff6c6f3 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:18.068034 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-f68028d3-342b-4a06-945a-a032fff6c6f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:56:18.068034 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:56:18.068034 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:56:18.068034 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:56:18.068034 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:56:18.068034 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:56:18.068034 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:56:18.068034 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:56:18.068034 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:56:18.068034 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:56:18.068034 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:56:18.068034 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:56:18.068034 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 15:56:18.068034 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 15:56:18.068034 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 15:56:18.069105 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 15:56:18.069105 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:56:18.069105 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:56:18.069105 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:56:18.069105 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:56:18.069105 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:56:18.069105 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:56:18.069105 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:56:18.069105 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:56:18.069105 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:56:18.069105 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:56:18.069105 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:56:18.069105 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:56:18.069105 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:56:18.069105 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:56:18.069105 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:56:18.069105 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:56:18.070297 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 15:56:18.070297 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 15:56:18.070297 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 15:56:18.070297 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 15:56:18.070297 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 15:56:18.070297 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 15:56:18.070297 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:56:18.070297 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:56:18.070297 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 442/892] 10.222.0.70 () {56 vars in 1111 bytes} [Fri Aug 19 15:56:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:56:18.075230 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc48eb-e196-46b2-9ea4-d7df10a89d7a None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:18.133606 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:56:18.178991 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc48eb-e196-46b2-9ea4-d7df10a89d7a None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:18.217770 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17091c65-6d78-4dc3-8e2a-e26b1274e6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:18.218406 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17091c65-6d78-4dc3-8e2a-e26b1274e6fa None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:18.218677 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17091c65-6d78-4dc3-8e2a-e26b1274e6fa None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:18.218944 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17091c65-6d78-4dc3-8e2a-e26b1274e6fa None admin] PATH_INFO: `/v3/projects` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:18.219631 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17091c65-6d78-4dc3-8e2a-e26b1274e6fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:56:18.219932 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17091c65-6d78-4dc3-8e2a-e26b1274e6fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:18.221438 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17091c65-6d78-4dc3-8e2a-e26b1274e6fa None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:18.234527 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 451/893] 10.222.0.70 () {56 vars in 1148 bytes} [Fri Aug 19 15:56:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:56:18.240899 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68028d3-342b-4a06-945a-a032fff6c6f3 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:18.336067 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:56:18.345019 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68028d3-342b-4a06-945a-a032fff6c6f3 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:18.381971 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10bff22-5513-4881-a047-0dcca5284f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:18.382625 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10bff22-5513-4881-a047-0dcca5284f39 None admin] REQUEST_METHOD: `PUT` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:18.382902 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10bff22-5513-4881-a047-0dcca5284f39 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:18.383174 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10bff22-5513-4881-a047-0dcca5284f39 None admin] PATH_INFO: `/v3/projects/48fb7e21c6864d30b70ffca9093afec8/users/580372230aad44269e3e0a7b230533f2/roles/2f6cb7d6ec874879972a12a63d61068d` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:18.385291 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10bff22-5513-4881-a047-0dcca5284f39 None admin] RBAC: Authorizing `identity:create_grant(project_id=48fb7e21c6864d30b70ffca9093afec8, user_id=580372230aad44269e3e0a7b230533f2, role_id=2f6cb7d6ec874879972a12a63d61068d)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:18.386668 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10bff22-5513-4881-a047-0dcca5284f39 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:18.511722 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 443/894] 10.222.0.70 () {58 vars in 1439 bytes} [Fri Aug 19 15:56:18 2022] PUT /identity/v3/projects/48fb7e21c6864d30b70ffca9093afec8/users/580372230aad44269e3e0a7b230533f2/roles/2f6cb7d6ec874879972a12a63d61068d => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:56:20.713522 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9343324-c19a-4c3d-8b66-5d3991b9c42e None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:20.714042 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9343324-c19a-4c3d-8b66-5d3991b9c42e None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:20.714254 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9343324-c19a-4c3d-8b66-5d3991b9c42e None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:20.715611 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 452/895] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:56:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:56:20.721266 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca6f0a-af2b-4a7d-8ee2-7ccf75c3bf1b None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:20.722457 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca6f0a-af2b-4a7d-8ee2-7ccf75c3bf1b None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:20.722457 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca6f0a-af2b-4a7d-8ee2-7ccf75c3bf1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:20.740399 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-9fca6f0a-af2b-4a7d-8ee2-7ccf75c3bf1b None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:56:20.741625 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-9fca6f0a-af2b-4a7d-8ee2-7ccf75c3bf1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:56:20.813886 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 444/896] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:56:20 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:56:21.147781 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9343324-c19a-4c3d-8b66-5d3991b9c42e None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:21.253052 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9343324-c19a-4c3d-8b66-5d3991b9c42e None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:21.267753 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:56:21.287455 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a7456-2b44-4acd-9ecc-c34f5a2e1340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:21.288081 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a7456-2b44-4acd-9ecc-c34f5a2e1340 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:21.288354 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a7456-2b44-4acd-9ecc-c34f5a2e1340 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:21.288623 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a7456-2b44-4acd-9ecc-c34f5a2e1340 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:21.299578 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81a7456-2b44-4acd-9ecc-c34f5a2e1340 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:56:21.304318 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-f81a7456-2b44-4acd-9ecc-c34f5a2e1340 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:56:21.304318 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:56:21.304318 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:56:21.304318 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:56:21.304318 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:56:21.304318 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:56:21.304318 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:56:21.304318 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:56:21.304318 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:56:21.304318 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:56:21.304318 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:56:21.304318 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:56:21.304318 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:56:21.304318 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:56:21.304318 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:56:21.304318 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:56:21.312335 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:56:21.312335 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:56:21.312335 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:56:21.312335 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:56:21.312335 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:56:21.312335 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:56:21.312335 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:56:21.312335 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:56:21.312335 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:56:21.312335 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:56:21.312335 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:56:21.312335 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:56:21.312335 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:56:21.312335 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:56:21.312335 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:56:21.312335 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:56:21.313221 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:56:21.313221 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:56:21.313221 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:56:21.313221 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:56:21.313221 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:56:21.313221 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:56:21.313221 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:56:21.313221 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:56:21.313221 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:56:21.313221 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:56:21.313221 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:56:21.313221 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:56:21.313221 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 453/897] 10.222.0.70 () {56 vars in 1096 bytes} [Fri Aug 19 15:56:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:56:21.313912 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca6f0a-af2b-4a7d-8ee2-7ccf75c3bf1b None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:21.397510 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:56:21.416413 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca6f0a-af2b-4a7d-8ee2-7ccf75c3bf1b None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:21.450200 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d6ccb-2c82-426c-a4f9-440953498aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:21.450813 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d6ccb-2c82-426c-a4f9-440953498aa2 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:21.451093 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d6ccb-2c82-426c-a4f9-440953498aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:21.451367 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d6ccb-2c82-426c-a4f9-440953498aa2 None admin] PATH_INFO: `/v3/roles` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:21.452128 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d6ccb-2c82-426c-a4f9-440953498aa2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:56:21.452431 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d6ccb-2c82-426c-a4f9-440953498aa2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:21.453829 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d6ccb-2c82-426c-a4f9-440953498aa2 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:21.464178 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 445/898] 10.222.0.70 () {56 vars in 1099 bytes} [Fri Aug 19 15:56:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:56:21.470431 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a7456-2b44-4acd-9ecc-c34f5a2e1340 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:21.575409 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a7456-2b44-4acd-9ecc-c34f5a2e1340 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:21.610271 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d182a92c-e532-4ee1-af96-fbd15b357a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:21.610869 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d182a92c-e532-4ee1-af96-fbd15b357a70 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:21.611139 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d182a92c-e532-4ee1-af96-fbd15b357a70 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:21.611408 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d182a92c-e532-4ee1-af96-fbd15b357a70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:21.623054 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d182a92c-e532-4ee1-af96-fbd15b357a70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:21.624529 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d182a92c-e532-4ee1-af96-fbd15b357a70 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:21.640056 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-d182a92c-e532-4ee1-af96-fbd15b357a70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:56:21.640056 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:56:21.640056 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:56:21.640056 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:56:21.640056 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:56:21.640056 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:56:21.640056 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:56:21.640056 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:56:21.640056 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:56:21.640056 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:56:21.640056 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:56:21.640056 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:56:21.640056 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:56:21.640056 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:56:21.640056 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:56:21.640056 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:56:21.644893 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:56:21.644893 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:56:21.644893 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:56:21.644893 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:56:21.644893 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:56:21.644893 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:56:21.644893 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:56:21.644893 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:56:21.644893 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:56:21.644893 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:56:21.644893 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:56:21.644893 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:56:21.644893 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:56:21.644893 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:56:21.644893 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:56:21.644893 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:56:21.644893 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:56:21.645779 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:56:21.645779 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:56:21.645779 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:56:21.645779 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 454/899] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:56:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:56:21.648248 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d6ccb-2c82-426c-a4f9-440953498aa2 None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:21.764854 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d6ccb-2c82-426c-a4f9-440953498aa2 None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:21.799989 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef378201-9a71-4f3e-86d6-946fbc303c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:21.800592 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef378201-9a71-4f3e-86d6-946fbc303c2d None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:21.800895 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef378201-9a71-4f3e-86d6-946fbc303c2d None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:21.801165 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef378201-9a71-4f3e-86d6-946fbc303c2d None admin] PATH_INFO: `/v3/domains` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:21.801800 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef378201-9a71-4f3e-86d6-946fbc303c2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:56:21.802099 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef378201-9a71-4f3e-86d6-946fbc303c2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:21.803445 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef378201-9a71-4f3e-86d6-946fbc303c2d None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:21.815681 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 446/900] 10.222.0.70 () {56 vars in 1109 bytes} [Fri Aug 19 15:56:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:56:21.821748 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d182a92c-e532-4ee1-af96-fbd15b357a70 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:21.853990 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:56:21.927963 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d182a92c-e532-4ee1-af96-fbd15b357a70 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:21.961349 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35092f7-ce13-4442-911f-094dfcb4a622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:21.961969 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35092f7-ce13-4442-911f-094dfcb4a622 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:21.962238 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35092f7-ce13-4442-911f-094dfcb4a622 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:21.963183 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35092f7-ce13-4442-911f-094dfcb4a622 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:21.970975 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35092f7-ce13-4442-911f-094dfcb4a622 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:21.972413 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35092f7-ce13-4442-911f-094dfcb4a622 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:21.984740 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-e35092f7-ce13-4442-911f-094dfcb4a622 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 15:56:21.984740 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:56:21.984740 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:56:21.984740 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:56:21.984740 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:56:21.984740 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:56:21.984740 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:56:21.984740 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:56:21.984740 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:56:21.984740 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:56:21.984740 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:56:21.984740 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:56:21.984740 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 15:56:21.984740 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 15:56:21.984740 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 15:56:21.984740 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 15:56:21.988864 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:56:21.988864 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:56:21.988864 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 15:56:21.988864 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:56:21.988864 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 15:56:21.988864 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:56:21.988864 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:56:21.988864 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:56:21.988864 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:56:21.988864 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:56:21.988864 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:56:21.988864 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:56:21.988864 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:56:21.988864 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:56:21.988864 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:56:21.988864 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:56:21.988864 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:56:21.988864 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:56:21.990580 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:56:21.990580 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:56:21.990580 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 15:56:21.990580 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 15:56:21.990580 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 15:56:21.990580 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 15:56:21.990580 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 15:56:21.990580 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 15:56:21.990580 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 15:56:21.990580 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:56:21.990580 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 455/901] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:56:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:56:21.992390 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef378201-9a71-4f3e-86d6-946fbc303c2d None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:21.997196 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:56:22.102206 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef378201-9a71-4f3e-86d6-946fbc303c2d None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:22.138688 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeed398-0a65-4c18-96aa-2185a51c14fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:22.139293 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeed398-0a65-4c18-96aa-2185a51c14fb None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:22.139565 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeed398-0a65-4c18-96aa-2185a51c14fb None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:22.139831 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeed398-0a65-4c18-96aa-2185a51c14fb None admin] PATH_INFO: `/v3/users` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:22.140551 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeed398-0a65-4c18-96aa-2185a51c14fb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:56:22.140883 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeed398-0a65-4c18-96aa-2185a51c14fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:22.142306 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeed398-0a65-4c18-96aa-2185a51c14fb None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:22.162329 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 447/902] 10.222.0.70 () {56 vars in 1143 bytes} [Fri Aug 19 15:56:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:56:22.168759 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35092f7-ce13-4442-911f-094dfcb4a622 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:22.259153 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:56:22.276437 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35092f7-ce13-4442-911f-094dfcb4a622 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:22.315769 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43cd5b1-f4ad-4b0d-82bb-06dd7aca51a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:22.316371 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43cd5b1-f4ad-4b0d-82bb-06dd7aca51a9 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:22.316651 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43cd5b1-f4ad-4b0d-82bb-06dd7aca51a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:22.316941 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43cd5b1-f4ad-4b0d-82bb-06dd7aca51a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:22.389983 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43cd5b1-f4ad-4b0d-82bb-06dd7aca51a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:22.391432 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43cd5b1-f4ad-4b0d-82bb-06dd7aca51a9 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:22.487506 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:56:22.504236 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 456/903] 10.222.0.70 () {58 vars in 1282 bytes} [Fri Aug 19 15:56:22 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 15:56:22.510558 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeed398-0a65-4c18-96aa-2185a51c14fb None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:22.573493 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:56:22.614643 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeed398-0a65-4c18-96aa-2185a51c14fb None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:22.649876 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b1e522-503d-44b6-a31b-1bacf20a0d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:22.650823 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1e522-503d-44b6-a31b-1bacf20a0d2f None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:22.650946 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1e522-503d-44b6-a31b-1bacf20a0d2f None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:22.651367 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1e522-503d-44b6-a31b-1bacf20a0d2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:22.667551 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b1e522-503d-44b6-a31b-1bacf20a0d2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:22.669063 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b1e522-503d-44b6-a31b-1bacf20a0d2f None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:22.684140 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-d4b1e522-503d-44b6-a31b-1bacf20a0d2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:56:22.684140 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:56:22.684140 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:56:22.684140 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:56:22.684140 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:56:22.684140 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:56:22.684140 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:56:22.684140 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:56:22.684140 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:56:22.684140 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:56:22.684140 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:56:22.684140 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:56:22.684140 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:56:22.684140 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:56:22.684140 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:56:22.684140 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:56:22.685317 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:56:22.685317 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:56:22.685317 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:56:22.685317 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:56:22.685317 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:56:22.685317 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:56:22.685317 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:56:22.685317 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:56:22.685317 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:56:22.685317 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:56:22.685317 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:56:22.685317 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:56:22.685317 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:56:22.685317 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:56:22.685317 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:56:22.685317 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:56:22.685317 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:56:22.686207 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:56:22.686207 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:56:22.686207 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:56:22.686207 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 448/904] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 15:56:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:56:22.691168 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43cd5b1-f4ad-4b0d-82bb-06dd7aca51a9 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:22.799085 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43cd5b1-f4ad-4b0d-82bb-06dd7aca51a9 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:22.838804 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a88793b-0e89-4fa0-9cba-38ad35e25591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:22.839851 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88793b-0e89-4fa0-9cba-38ad35e25591 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:22.840135 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88793b-0e89-4fa0-9cba-38ad35e25591 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:22.840489 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88793b-0e89-4fa0-9cba-38ad35e25591 None admin] PATH_INFO: `/v3/domains` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:22.841312 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a88793b-0e89-4fa0-9cba-38ad35e25591 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:56:22.841697 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a88793b-0e89-4fa0-9cba-38ad35e25591 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:22.843201 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a88793b-0e89-4fa0-9cba-38ad35e25591 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:22.855809 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 457/905] 10.222.0.70 () {56 vars in 1109 bytes} [Fri Aug 19 15:56:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:56:22.861517 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b1e522-503d-44b6-a31b-1bacf20a0d2f None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:22.980656 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b1e522-503d-44b6-a31b-1bacf20a0d2f None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:22.994794 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:56:23.015432 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc6ca03-cd95-4a16-a326-6912232edf4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:23.016054 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6ca03-cd95-4a16-a326-6912232edf4f None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:23.016334 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6ca03-cd95-4a16-a326-6912232edf4f None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:23.016599 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6ca03-cd95-4a16-a326-6912232edf4f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:23.023139 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc6ca03-cd95-4a16-a326-6912232edf4f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:23.024561 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc6ca03-cd95-4a16-a326-6912232edf4f None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:23.036279 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application [None req-afc6ca03-cd95-4a16-a326-6912232edf4f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:56:23.036279 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:56:23.036279 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:56:23.036279 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:56:23.036279 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:56:23.036279 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:56:23.036279 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:56:23.036279 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:56:23.036279 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:56:23.036279 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:56:23.036279 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:56:23.036279 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:56:23.036279 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 15:56:23.036279 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 15:56:23.036279 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 15:56:23.041975 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 15:56:23.041975 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:56:23.041975 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:56:23.041975 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:56:23.041975 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:56:23.041975 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:56:23.041975 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:56:23.041975 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:56:23.041975 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application with Lock( Aug 19 15:56:23.041975 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:56:23.041975 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:56:23.041975 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:56:23.041975 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:56:23.041975 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:56:23.041975 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:56:23.041975 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:56:23.041975 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:56:23.043090 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 15:56:23.043090 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 15:56:23.043090 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 15:56:23.043090 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 15:56:23.043090 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 15:56:23.043090 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 15:56:23.043090 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:56:23.043090 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: ERROR keystone.server.flask.application Aug 19 15:56:23.043090 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 449/906] 10.222.0.70 () {56 vars in 1111 bytes} [Fri Aug 19 15:56:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:56:23.044021 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a88793b-0e89-4fa0-9cba-38ad35e25591 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:23.092160 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:56:23.145691 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a88793b-0e89-4fa0-9cba-38ad35e25591 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:23.180538 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f83fd-80f2-4103-9d02-102388bc6bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:23.181217 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f83fd-80f2-4103-9d02-102388bc6bed None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:23.181600 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f83fd-80f2-4103-9d02-102388bc6bed None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:23.181817 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f83fd-80f2-4103-9d02-102388bc6bed None admin] PATH_INFO: `/v3/projects` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:23.182497 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111f83fd-80f2-4103-9d02-102388bc6bed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:56:23.182796 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111f83fd-80f2-4103-9d02-102388bc6bed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:23.184217 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111f83fd-80f2-4103-9d02-102388bc6bed None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:23.198171 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 458/907] 10.222.0.70 () {56 vars in 1148 bytes} [Fri Aug 19 15:56:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:56:23.204356 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc6ca03-cd95-4a16-a326-6912232edf4f None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:23.307929 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc6ca03-cd95-4a16-a326-6912232edf4f None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:23.346983 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c5b570-960e-47b5-8edf-69499fb2c278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:23.347590 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c5b570-960e-47b5-8edf-69499fb2c278 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:23.347869 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c5b570-960e-47b5-8edf-69499fb2c278 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:23.348145 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c5b570-960e-47b5-8edf-69499fb2c278 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:23.348958 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c5b570-960e-47b5-8edf-69499fb2c278 None admin] RBAC: Adding query filter params (role.id=2f6cb7d6ec874879972a12a63d61068d, scope.project.id=48fb7e21c6864d30b70ffca9093afec8, user.id=580372230aad44269e3e0a7b230533f2) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:56:23.349265 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c5b570-960e-47b5-8edf-69499fb2c278 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:23.350958 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c5b570-960e-47b5-8edf-69499fb2c278 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:23.360015 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 450/908] 10.222.0.70 () {56 vars in 1374 bytes} [Fri Aug 19 15:56:23 2022] GET /identity/v3/role_assignments?user.id=580372230aad44269e3e0a7b230533f2&scope.project.id=48fb7e21c6864d30b70ffca9093afec8&role.id=2f6cb7d6ec874879972a12a63d61068d => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:56:25.583130 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94ba59-5668-4f98-949a-18b0704de434 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:25.583644 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94ba59-5668-4f98-949a-18b0704de434 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:25.583644 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94ba59-5668-4f98-949a-18b0704de434 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:25.585024 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 459/909] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:56:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:56:25.591370 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8109e-3cb3-4c7f-ba94-ba46e9d85eaf None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:25.591769 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8109e-3cb3-4c7f-ba94-ba46e9d85eaf None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:25.591907 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8109e-3cb3-4c7f-ba94-ba46e9d85eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:25.610371 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-65b8109e-3cb3-4c7f-ba94-ba46e9d85eaf None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:56:25.611489 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-65b8109e-3cb3-4c7f-ba94-ba46e9d85eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:56:25.641733 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:56:25.677446 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 451/910] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:56:25 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:56:26.010168 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef94ba59-5668-4f98-949a-18b0704de434 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:26.121755 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef94ba59-5668-4f98-949a-18b0704de434 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:26.129718 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:56:26.157380 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f09a10b-b4fb-4435-b7bf-1c3b868fdf76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:26.158113 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09a10b-b4fb-4435-b7bf-1c3b868fdf76 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:26.158429 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09a10b-b4fb-4435-b7bf-1c3b868fdf76 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:26.158764 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09a10b-b4fb-4435-b7bf-1c3b868fdf76 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:26.159379 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f09a10b-b4fb-4435-b7bf-1c3b868fdf76 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:26.160901 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f09a10b-b4fb-4435-b7bf-1c3b868fdf76 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:26.170708 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-4f09a10b-b4fb-4435-b7bf-1c3b868fdf76 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 15:56:26.170708 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:56:26.170708 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 15:56:26.170708 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 15:56:26.170708 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 15:56:26.170708 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 15:56:26.170708 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 15:56:26.170708 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:56:26.170708 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 15:56:26.170708 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:56:26.170708 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 15:56:26.170708 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:56:26.170708 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:56:26.170708 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:56:26.170708 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:56:26.170708 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:56:26.170708 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:56:26.171960 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:56:26.171960 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:56:26.171960 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:56:26.171960 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:56:26.171960 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:56:26.171960 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:56:26.171960 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 15:56:26.171960 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 15:56:26.171960 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 15:56:26.171960 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 15:56:26.171960 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:56:26.171960 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:56:26.171960 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:56:26.171960 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:56:26.171960 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:56:26.171960 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:56:26.177314 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:56:26.177314 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:56:26.177314 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:56:26.177314 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:56:26.177314 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:56:26.177314 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:56:26.177314 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:56:26.177314 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:56:26.177314 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:56:26.177314 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:56:26.177314 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 15:56:26.177314 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:56:26.177314 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 15:56:26.177314 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:56:26.177314 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 460/911] 10.222.0.70 () {56 vars in 1117 bytes} [Fri Aug 19 15:56:26 2022] GET /identity/v3/services/placement => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:56:26.178212 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b8109e-3cb3-4c7f-ba94-ba46e9d85eaf None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:26.291919 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b8109e-3cb3-4c7f-ba94-ba46e9d85eaf None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:26.328387 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04991573-5e72-4b91-aa47-1d4af157d5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:26.329023 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04991573-5e72-4b91-aa47-1d4af157d5a4 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:26.329297 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04991573-5e72-4b91-aa47-1d4af157d5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:26.329566 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04991573-5e72-4b91-aa47-1d4af157d5a4 None admin] PATH_INFO: `/v3/services` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:26.330247 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04991573-5e72-4b91-aa47-1d4af157d5a4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:56:26.330546 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04991573-5e72-4b91-aa47-1d4af157d5a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:26.331899 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04991573-5e72-4b91-aa47-1d4af157d5a4 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:26.337105 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 452/912] 10.222.0.70 () {56 vars in 1116 bytes} [Fri Aug 19 15:56:26 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:56:26.343736 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f09a10b-b4fb-4435-b7bf-1c3b868fdf76 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:26.448260 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f09a10b-b4fb-4435-b7bf-1c3b868fdf76 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:26.487812 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3812b204-68ff-4980-9c54-81c7c0a56fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:26.488429 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812b204-68ff-4980-9c54-81c7c0a56fe6 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:26.488738 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812b204-68ff-4980-9c54-81c7c0a56fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:26.489012 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812b204-68ff-4980-9c54-81c7c0a56fe6 None admin] PATH_INFO: `/v3/services` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:26.489646 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3812b204-68ff-4980-9c54-81c7c0a56fe6 None admin] RBAC: Adding query filter params (type=placement) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:56:26.489964 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3812b204-68ff-4980-9c54-81c7c0a56fe6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:26.491334 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3812b204-68ff-4980-9c54-81c7c0a56fe6 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:26.496780 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 461/913] 10.222.0.70 () {56 vars in 1116 bytes} [Fri Aug 19 15:56:26 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:56:28.699657 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e6c36-830b-46c6-9397-2d58f237b7b5 None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:28.700249 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e6c36-830b-46c6-9397-2d58f237b7b5 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:28.700249 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e6c36-830b-46c6-9397-2d58f237b7b5 None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:28.701506 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 453/914] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:56:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:56:28.706803 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6db02-311a-4ed7-a1e8-19fca160a361 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:28.707229 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6db02-311a-4ed7-a1e8-19fca160a361 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:28.707370 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6db02-311a-4ed7-a1e8-19fca160a361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:28.725523 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-89f6db02-311a-4ed7-a1e8-19fca160a361 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:56:28.727961 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-89f6db02-311a-4ed7-a1e8-19fca160a361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:56:28.753524 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:56:28.792469 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 462/915] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:56:28 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:56:29.117678 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e6c36-830b-46c6-9397-2d58f237b7b5 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:29.149658 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:56:29.219823 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e6c36-830b-46c6-9397-2d58f237b7b5 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:29.256257 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd270ca-d6c1-46f0-befd-e0240d82c864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:29.258681 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd270ca-d6c1-46f0-befd-e0240d82c864 None admin] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:29.258681 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd270ca-d6c1-46f0-befd-e0240d82c864 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:29.258681 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd270ca-d6c1-46f0-befd-e0240d82c864 None admin] PATH_INFO: `/v3/services` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:29.258681 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd270ca-d6c1-46f0-befd-e0240d82c864 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:29.259642 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd270ca-d6c1-46f0-befd-e0240d82c864 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:29.487465 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 454/916] 10.222.0.70 () {60 vars in 1141 bytes} [Fri Aug 19 15:56:29 2022] POST /identity/v3/services => generated 246 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:56:31.755488 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f911c-cccc-4255-9dda-c7d1084fa0bb None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:31.756069 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f911c-cccc-4255-9dda-c7d1084fa0bb None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:31.756069 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f911c-cccc-4255-9dda-c7d1084fa0bb None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:31.757432 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 463/917] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:56:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:56:31.764087 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964d2fb-76e1-4a53-b4a0-9e7ee1d71ae5 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:31.764556 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964d2fb-76e1-4a53-b4a0-9e7ee1d71ae5 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:31.764650 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964d2fb-76e1-4a53-b4a0-9e7ee1d71ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:31.782714 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-1964d2fb-76e1-4a53-b4a0-9e7ee1d71ae5 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:56:31.786106 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-1964d2fb-76e1-4a53-b4a0-9e7ee1d71ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:56:31.860474 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 455/918] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:56:31 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:56:32.186002 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f911c-cccc-4255-9dda-c7d1084fa0bb None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:32.288058 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f911c-cccc-4255-9dda-c7d1084fa0bb None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:32.323439 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6d759-6120-4f71-a437-a406e28b3f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:32.330420 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6d759-6120-4f71-a437-a406e28b3f01 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:32.330420 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6d759-6120-4f71-a437-a406e28b3f01 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:32.330420 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6d759-6120-4f71-a437-a406e28b3f01 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:32.330420 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d6d759-6120-4f71-a437-a406e28b3f01 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:32.330420 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d6d759-6120-4f71-a437-a406e28b3f01 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:32.335631 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-33d6d759-6120-4f71-a437-a406e28b3f01 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 15:56:32.335631 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:56:32.335631 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 15:56:32.335631 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 15:56:32.335631 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 15:56:32.335631 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 15:56:32.335631 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 15:56:32.335631 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:56:32.335631 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 15:56:32.335631 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:56:32.335631 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 15:56:32.335631 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:56:32.335631 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:56:32.335631 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:56:32.335631 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:56:32.335631 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:56:32.335631 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:56:32.336709 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:56:32.336709 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:56:32.336709 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:56:32.336709 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:56:32.336709 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:56:32.336709 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:56:32.336709 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 15:56:32.336709 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 15:56:32.336709 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 15:56:32.336709 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 15:56:32.336709 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:56:32.336709 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:56:32.336709 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:56:32.336709 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:56:32.336709 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:56:32.336709 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:56:32.338792 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:56:32.338792 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:56:32.338792 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:56:32.338792 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:56:32.338792 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:56:32.338792 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:56:32.338792 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:56:32.338792 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:56:32.338792 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:56:32.338792 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:56:32.338792 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 15:56:32.338792 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:56:32.338792 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 15:56:32.338792 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:56:32.338792 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 464/919] 10.222.0.70 () {56 vars in 1117 bytes} [Fri Aug 19 15:56:32 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:56:32.343408 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964d2fb-76e1-4a53-b4a0-9e7ee1d71ae5 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:32.364339 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:56:32.444377 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964d2fb-76e1-4a53-b4a0-9e7ee1d71ae5 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:32.479483 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1b3c6-94d8-4781-8ace-28bda54635fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:32.480078 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1b3c6-94d8-4781-8ace-28bda54635fa None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:32.480353 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1b3c6-94d8-4781-8ace-28bda54635fa None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:32.480618 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1b3c6-94d8-4781-8ace-28bda54635fa None admin] PATH_INFO: `/v3/services` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:32.481376 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff1b3c6-94d8-4781-8ace-28bda54635fa None admin] RBAC: Adding query filter params (name=placement) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:56:32.481667 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff1b3c6-94d8-4781-8ace-28bda54635fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:32.483039 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff1b3c6-94d8-4781-8ace-28bda54635fa None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:32.488100 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 456/920] 10.222.0.70 () {56 vars in 1116 bytes} [Fri Aug 19 15:56:32 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:56:32.494262 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6d759-6120-4f71-a437-a406e28b3f01 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:32.523958 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:56:32.597435 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6d759-6120-4f71-a437-a406e28b3f01 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:32.631634 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29522a4-0350-4f1a-ad05-5b30e41adbb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:32.632227 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29522a4-0350-4f1a-ad05-5b30e41adbb4 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:32.632496 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29522a4-0350-4f1a-ad05-5b30e41adbb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:32.632793 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29522a4-0350-4f1a-ad05-5b30e41adbb4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:32.633480 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29522a4-0350-4f1a-ad05-5b30e41adbb4 None admin] RBAC: Adding query filter params (interface=public, service_id=d33c84a649cc4d81831cc25ecdfb46ca, region_id=RegionOne) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:56:32.633780 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29522a4-0350-4f1a-ad05-5b30e41adbb4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:32.635876 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29522a4-0350-4f1a-ad05-5b30e41adbb4 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:32.640847 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 465/921] 10.222.0.70 () {56 vars in 1251 bytes} [Fri Aug 19 15:56:32 2022] GET /identity/v3/endpoints?service_id=d33c84a649cc4d81831cc25ecdfb46ca&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:56:32.646777 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1b3c6-94d8-4781-8ace-28bda54635fa None admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:32.729800 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:56:32.747952 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1b3c6-94d8-4781-8ace-28bda54635fa None admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:32.780385 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef64d588-61ae-4744-b896-811b7086f8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:32.781167 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64d588-61ae-4744-b896-811b7086f8fa None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:32.781387 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64d588-61ae-4744-b896-811b7086f8fa None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:32.781532 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64d588-61ae-4744-b896-811b7086f8fa None admin] PATH_INFO: `/v3/services` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:32.782132 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef64d588-61ae-4744-b896-811b7086f8fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:32.783488 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef64d588-61ae-4744-b896-811b7086f8fa None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:32.789933 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 457/922] 10.222.0.70 () {56 vars in 1087 bytes} [Fri Aug 19 15:56:32 2022] GET /identity/v3/services => generated 1962 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:56:35.033233 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6242516-8707-4b7e-a426-e4393b069cf7 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:35.033792 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6242516-8707-4b7e-a426-e4393b069cf7 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:35.033792 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6242516-8707-4b7e-a426-e4393b069cf7 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:35.035103 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 466/923] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 15:56:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:56:35.041069 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4d28a-b9de-4db9-ace5-b326becf61a7 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:35.041649 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4d28a-b9de-4db9-ace5-b326becf61a7 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:35.041649 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4d28a-b9de-4db9-ace5-b326becf61a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:35.060281 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-f9b4d28a-b9de-4db9-ace5-b326becf61a7 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:56:35.061502 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-f9b4d28a-b9de-4db9-ace5-b326becf61a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:56:35.128837 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 458/924] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 15:56:35 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:56:35.464483 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6242516-8707-4b7e-a426-e4393b069cf7 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:35.559205 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:56:35.568454 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6242516-8707-4b7e-a426-e4393b069cf7 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:35.602583 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c548d3b-e388-4560-8749-4d5a50b31b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:35.606297 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c548d3b-e388-4560-8749-4d5a50b31b48 None admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:35.606297 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c548d3b-e388-4560-8749-4d5a50b31b48 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:35.606297 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c548d3b-e388-4560-8749-4d5a50b31b48 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:35.606297 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c548d3b-e388-4560-8749-4d5a50b31b48 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:35.606619 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c548d3b-e388-4560-8749-4d5a50b31b48 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:35.615323 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application [None req-0c548d3b-e388-4560-8749-4d5a50b31b48 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 15:56:35.615323 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:56:35.615323 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 15:56:35.615323 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 15:56:35.615323 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 15:56:35.615323 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 15:56:35.615323 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 15:56:35.615323 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:56:35.615323 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 15:56:35.615323 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:56:35.615323 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 15:56:35.615323 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:56:35.615323 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:56:35.615323 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:56:35.615323 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:56:35.615323 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:56:35.615323 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:56:35.616484 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:56:35.616484 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:56:35.616484 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:56:35.616484 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:56:35.616484 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:56:35.616484 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:56:35.616484 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 15:56:35.616484 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 15:56:35.616484 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 15:56:35.616484 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 15:56:35.616484 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:56:35.616484 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:56:35.616484 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:56:35.616484 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:56:35.616484 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:56:35.616484 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:56:35.617356 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:56:35.617356 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application with Lock( Aug 19 15:56:35.617356 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:56:35.617356 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:56:35.617356 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:56:35.617356 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:56:35.617356 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:56:35.617356 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:56:35.617356 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:56:35.617356 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:56:35.617356 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 15:56:35.617356 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:56:35.617356 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 15:56:35.617356 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: ERROR keystone.server.flask.application Aug 19 15:56:35.617356 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 467/925] 10.222.0.70 () {56 vars in 1117 bytes} [Fri Aug 19 15:56:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:56:35.623106 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b4d28a-b9de-4db9-ace5-b326becf61a7 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:35.702109 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:56:35.724082 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b4d28a-b9de-4db9-ace5-b326becf61a7 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:35.760027 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020b4b2d-3641-40a0-a9d7-5fb27e85c799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:35.760674 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b4b2d-3641-40a0-a9d7-5fb27e85c799 None admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:35.760985 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b4b2d-3641-40a0-a9d7-5fb27e85c799 None admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:35.761460 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b4b2d-3641-40a0-a9d7-5fb27e85c799 None admin] PATH_INFO: `/v3/services` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:35.762258 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020b4b2d-3641-40a0-a9d7-5fb27e85c799 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:56:35.763034 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020b4b2d-3641-40a0-a9d7-5fb27e85c799 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:35.764424 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020b4b2d-3641-40a0-a9d7-5fb27e85c799 None admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:35.769592 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 459/926] 10.222.0.70 () {56 vars in 1116 bytes} [Fri Aug 19 15:56:35 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:56:35.775724 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c548d3b-e388-4560-8749-4d5a50b31b48 None admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:56:35.875127 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c548d3b-e388-4560-8749-4d5a50b31b48 None admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:56:35.908360 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c522344-6294-4e84-bbee-8adb850abf72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:56:35.908990 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c522344-6294-4e84-bbee-8adb850abf72 None admin] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:56:35.909266 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c522344-6294-4e84-bbee-8adb850abf72 None admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:56:35.909535 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c522344-6294-4e84-bbee-8adb850abf72 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:56:35.910185 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c522344-6294-4e84-bbee-8adb850abf72 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:56:35.911538 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c522344-6294-4e84-bbee-8adb850abf72 None admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:56:36.019938 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 468/927] 10.222.0.70 () {60 vars in 1144 bytes} [Fri Aug 19 15:56:35 2022] POST /identity/v3/endpoints => generated 331 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:56:45.766574 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=30 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:56:46.015145 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:03:42.557246 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3477d2-b6a0-4b7b-b845-b3496da28bab None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:03:42.558561 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3477d2-b6a0-4b7b-b845-b3496da28bab None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:03:42.558851 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3477d2-b6a0-4b7b-b845-b3496da28bab None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:03:42.563026 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 460/928] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 16:03:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:03:42.566729 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425f720-8291-4fab-b554-9a1eab23251b None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:03:42.567181 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425f720-8291-4fab-b554-9a1eab23251b None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:03:42.567276 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425f720-8291-4fab-b554-9a1eab23251b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:03:42.686382 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-9425f720-8291-4fab-b554-9a1eab23251b None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:03:42.689890 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-9425f720-8291-4fab-b554-9a1eab23251b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:03:42.830476 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 469/929] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 16:03:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:03:43.201771 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92846f-d241-4ab4-97d3-9616b1f8f74d None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:03:43.202048 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92846f-d241-4ab4-97d3-9616b1f8f74d None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:03:43.202341 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92846f-d241-4ab4-97d3-9616b1f8f74d None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:03:43.203758 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 461/930] 10.222.0.70 () {54 vars in 965 bytes} [Fri Aug 19 16:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:03:43.209860 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e7883-77d1-401f-ae9d-ca65f6f1248c None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:03:43.210213 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e7883-77d1-401f-ae9d-ca65f6f1248c None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:03:43.217541 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e7883-77d1-401f-ae9d-ca65f6f1248c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:03:43.282471 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-fd0e7883-77d1-401f-ae9d-ca65f6f1248c None None] MFA Rules not processed for user `f5593ee9d30b4b65a215a4fe8dfba060`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:03:43.283670 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-fd0e7883-77d1-401f-ae9d-ca65f6f1248c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:03:43.314123 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:03:43.360702 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 470/931] 10.222.0.70 () {58 vars in 1062 bytes} [Fri Aug 19 16:03:43 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:03:43.370743 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f92846f-d241-4ab4-97d3-9616b1f8f74d None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:03:43.382599 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f92846f-d241-4ab4-97d3-9616b1f8f74d None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:03:43.386742 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc829b3-f66e-4088-9f0e-c5ae5cb186ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5593ee9d30b4b65a215a4fe8dfba060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:03:43.387366 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc829b3-f66e-4088-9f0e-c5ae5cb186ba service neutron] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:03:43.387644 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc829b3-f66e-4088-9f0e-c5ae5cb186ba service neutron] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:03:43.387913 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc829b3-f66e-4088-9f0e-c5ae5cb186ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:03:43.398252 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc829b3-f66e-4088-9f0e-c5ae5cb186ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:03:43.400298 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc829b3-f66e-4088-9f0e-c5ae5cb186ba service neutron] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:03:43.411078 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 462/932] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:03:43 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:03:45.915823 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2224f38-156a-457a-b0fc-5e8a0535bd09 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:03:45.916361 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2224f38-156a-457a-b0fc-5e8a0535bd09 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:03:45.916361 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2224f38-156a-457a-b0fc-5e8a0535bd09 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:03:45.917734 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 471/933] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 16:03:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:03:45.922825 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c41021-0a4d-4f71-8bea-d61df225695e None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:03:45.923268 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c41021-0a4d-4f71-8bea-d61df225695e None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:03:45.923363 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c41021-0a4d-4f71-8bea-d61df225695e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:03:45.942550 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-b6c41021-0a4d-4f71-8bea-d61df225695e None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:03:45.943745 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-b6c41021-0a4d-4f71-8bea-d61df225695e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:03:45.952346 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 463/934] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 16:03:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:03:46.305744 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2224f38-156a-457a-b0fc-5e8a0535bd09 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:03:46.316245 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2224f38-156a-457a-b0fc-5e8a0535bd09 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:03:46.320070 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e205f2-a551-4c82-a7d0-b39c85df0d15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5593ee9d30b4b65a215a4fe8dfba060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:03:46.320685 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e205f2-a551-4c82-a7d0-b39c85df0d15 service neutron] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:03:46.321092 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e205f2-a551-4c82-a7d0-b39c85df0d15 service neutron] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:03:46.321371 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e205f2-a551-4c82-a7d0-b39c85df0d15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:03:46.330642 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e205f2-a551-4c82-a7d0-b39c85df0d15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:03:46.332075 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e205f2-a551-4c82-a7d0-b39c85df0d15 service neutron] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:03:46.342099 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 472/935] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:03:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:03:49.009810 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301f0d0-82d3-46f2-95a5-86016f76c07e None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:03:49.010337 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301f0d0-82d3-46f2-95a5-86016f76c07e None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:03:49.010337 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301f0d0-82d3-46f2-95a5-86016f76c07e None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:03:49.011833 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 464/936] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 16:03:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:03:49.017071 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5bd13-7929-42cd-8917-50fa49256759 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:03:49.017523 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5bd13-7929-42cd-8917-50fa49256759 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:03:49.017603 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5bd13-7929-42cd-8917-50fa49256759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:03:49.079549 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-c8c5bd13-7929-42cd-8917-50fa49256759 None None] MFA Rules not processed for user `07c52c5ae7fc4412b1e1a11890bb9362`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:03:49.080786 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-c8c5bd13-7929-42cd-8917-50fa49256759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:03:49.170447 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 473/937] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 16:03:49 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:03:49.514832 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301f0d0-82d3-46f2-95a5-86016f76c07e None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:03:49.526595 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301f0d0-82d3-46f2-95a5-86016f76c07e None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:03:49.530439 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7c0f70-3452-4dd8-a93d-84785bda86d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5593ee9d30b4b65a215a4fe8dfba060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:03:49.531246 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c0f70-3452-4dd8-a93d-84785bda86d9 service neutron] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:03:49.531509 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c0f70-3452-4dd8-a93d-84785bda86d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:03:49.531777 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c0f70-3452-4dd8-a93d-84785bda86d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:03:49.542852 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7c0f70-3452-4dd8-a93d-84785bda86d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:03:49.544303 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7c0f70-3452-4dd8-a93d-84785bda86d9 service neutron] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:03:49.566403 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 465/938] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:03:49 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:03:52.696088 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bacb80-389a-452c-8e26-d0d637ff0d49 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:03:52.696611 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bacb80-389a-452c-8e26-d0d637ff0d49 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:03:52.696611 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bacb80-389a-452c-8e26-d0d637ff0d49 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:03:52.697958 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 474/939] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 16:03:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:03:52.703158 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496e55d-101d-44ff-9733-d9f581e4ffa1 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:03:52.703583 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496e55d-101d-44ff-9733-d9f581e4ffa1 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:03:52.703687 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496e55d-101d-44ff-9733-d9f581e4ffa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:03:52.723269 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-7496e55d-101d-44ff-9733-d9f581e4ffa1 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:03:52.724448 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-7496e55d-101d-44ff-9733-d9f581e4ffa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:03:52.796563 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 466/940] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 16:03:52 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:03:53.139664 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bacb80-389a-452c-8e26-d0d637ff0d49 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:03:53.150341 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bacb80-389a-452c-8e26-d0d637ff0d49 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:03:53.153782 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01abec3d-65b7-4ad9-afab-a385943bd177 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5593ee9d30b4b65a215a4fe8dfba060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:03:53.154361 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01abec3d-65b7-4ad9-afab-a385943bd177 service neutron] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:03:53.154635 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01abec3d-65b7-4ad9-afab-a385943bd177 service neutron] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:03:53.154902 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01abec3d-65b7-4ad9-afab-a385943bd177 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:03:53.163448 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01abec3d-65b7-4ad9-afab-a385943bd177 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:03:53.164986 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01abec3d-65b7-4ad9-afab-a385943bd177 service neutron] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:03:53.174077 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 475/941] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:03:53 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:03:56.467107 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f1f36-2b3c-429f-bc12-c1e1f40a2715 None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:03:56.467678 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f1f36-2b3c-429f-bc12-c1e1f40a2715 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:03:56.467678 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f1f36-2b3c-429f-bc12-c1e1f40a2715 None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:03:56.469026 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 467/942] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 16:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:03:56.474526 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11986fdc-3314-4612-bd18-3e0a0d862b40 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:03:56.474960 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11986fdc-3314-4612-bd18-3e0a0d862b40 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:03:56.475080 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11986fdc-3314-4612-bd18-3e0a0d862b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:03:56.495630 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-11986fdc-3314-4612-bd18-3e0a0d862b40 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:03:56.496952 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-11986fdc-3314-4612-bd18-3e0a0d862b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:03:56.504748 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 476/943] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 16:03:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:03:56.846566 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f1f36-2b3c-429f-bc12-c1e1f40a2715 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:03:56.858186 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f1f36-2b3c-429f-bc12-c1e1f40a2715 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:03:56.861764 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2586c8c-9589-484e-9c2b-40d0dda568ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5593ee9d30b4b65a215a4fe8dfba060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:03:56.862346 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2586c8c-9589-484e-9c2b-40d0dda568ce service neutron] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:03:56.862618 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2586c8c-9589-484e-9c2b-40d0dda568ce service neutron] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:03:56.862885 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2586c8c-9589-484e-9c2b-40d0dda568ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:03:56.872761 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2586c8c-9589-484e-9c2b-40d0dda568ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:03:56.874168 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2586c8c-9589-484e-9c2b-40d0dda568ce service neutron] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:03:56.883988 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 468/944] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:03:56 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:03:59.128366 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f75cd-0307-470a-b861-5e9967adef12 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:03:59.128909 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f75cd-0307-470a-b861-5e9967adef12 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:03:59.128909 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f75cd-0307-470a-b861-5e9967adef12 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:03:59.130144 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 477/945] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 16:03:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:03:59.135868 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c44e2a-9872-41c5-9143-0f7b8f54824c None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:03:59.136311 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c44e2a-9872-41c5-9143-0f7b8f54824c None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:03:59.136445 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c44e2a-9872-41c5-9143-0f7b8f54824c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:03:59.155107 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-49c44e2a-9872-41c5-9143-0f7b8f54824c None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:03:59.156274 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-49c44e2a-9872-41c5-9143-0f7b8f54824c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:03:59.164136 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 469/946] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 16:03:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:03:59.505334 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f75cd-0307-470a-b861-5e9967adef12 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:03:59.516289 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f75cd-0307-470a-b861-5e9967adef12 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:03:59.519797 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae275dac-793a-4ddd-ad86-8860c02f70fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5593ee9d30b4b65a215a4fe8dfba060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:03:59.520378 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae275dac-793a-4ddd-ad86-8860c02f70fc service neutron] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:03:59.520646 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae275dac-793a-4ddd-ad86-8860c02f70fc service neutron] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:03:59.520940 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae275dac-793a-4ddd-ad86-8860c02f70fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:03:59.532330 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae275dac-793a-4ddd-ad86-8860c02f70fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:03:59.533792 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae275dac-793a-4ddd-ad86-8860c02f70fc service neutron] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:03:59.544471 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 478/947] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:03:59 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:04:01.794871 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a1d48-ea6d-41a0-a179-3450328da0ce None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:04:01.795408 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a1d48-ea6d-41a0-a179-3450328da0ce None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:04:01.795408 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a1d48-ea6d-41a0-a179-3450328da0ce None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:04:01.796742 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 470/948] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 16:04:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:04:01.801947 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77afee86-e348-4ed4-bd62-f8259a7ed995 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:04:01.802355 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77afee86-e348-4ed4-bd62-f8259a7ed995 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:04:01.802487 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77afee86-e348-4ed4-bd62-f8259a7ed995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:04:01.821831 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-77afee86-e348-4ed4-bd62-f8259a7ed995 None None] MFA Rules not processed for user `07c52c5ae7fc4412b1e1a11890bb9362`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:04:01.823019 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-77afee86-e348-4ed4-bd62-f8259a7ed995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:04:01.830836 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 479/949] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 16:04:01 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:04:02.171457 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a1d48-ea6d-41a0-a179-3450328da0ce None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:04:02.182896 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a1d48-ea6d-41a0-a179-3450328da0ce None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:04:02.186438 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ed411-9053-480c-b4b9-c8e86657a10e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5593ee9d30b4b65a215a4fe8dfba060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:04:02.187029 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ed411-9053-480c-b4b9-c8e86657a10e service neutron] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:04:02.187305 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ed411-9053-480c-b4b9-c8e86657a10e service neutron] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:04:02.187575 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ed411-9053-480c-b4b9-c8e86657a10e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:04:02.197582 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41ed411-9053-480c-b4b9-c8e86657a10e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:04:02.199011 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41ed411-9053-480c-b4b9-c8e86657a10e service neutron] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:04:02.208526 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 471/950] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:04:02 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:04:04.941746 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c191da-1a64-4e1e-a10b-9e14feed84b9 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:04:04.942273 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c191da-1a64-4e1e-a10b-9e14feed84b9 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:04:04.942273 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c191da-1a64-4e1e-a10b-9e14feed84b9 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:04:04.943603 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 480/951] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 16:04:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:04:04.948963 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad499c-9f60-40b7-91ed-63bbebff5862 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:04:04.949379 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad499c-9f60-40b7-91ed-63bbebff5862 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:04:04.949616 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad499c-9f60-40b7-91ed-63bbebff5862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:04:04.969223 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-79ad499c-9f60-40b7-91ed-63bbebff5862 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:04:04.970392 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-79ad499c-9f60-40b7-91ed-63bbebff5862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:04:04.978892 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 472/952] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 16:04:04 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:04:05.331130 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c191da-1a64-4e1e-a10b-9e14feed84b9 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:04:05.342716 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c191da-1a64-4e1e-a10b-9e14feed84b9 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:04:05.346359 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1060866d-bd2f-445d-8236-eeecf28d7707 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5593ee9d30b4b65a215a4fe8dfba060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:04:05.346957 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060866d-bd2f-445d-8236-eeecf28d7707 service neutron] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:04:05.347232 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060866d-bd2f-445d-8236-eeecf28d7707 service neutron] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:04:05.347501 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060866d-bd2f-445d-8236-eeecf28d7707 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:04:05.357286 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1060866d-bd2f-445d-8236-eeecf28d7707 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:04:05.358687 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1060866d-bd2f-445d-8236-eeecf28d7707 service neutron] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:04:05.364371 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=100 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:04:05.369804 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 481/953] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:04:05 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:04:07.635488 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de03b6-697e-41a2-859b-a7f08505b259 None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:04:07.635991 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de03b6-697e-41a2-859b-a7f08505b259 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:04:07.635991 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de03b6-697e-41a2-859b-a7f08505b259 None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:04:07.637331 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 473/954] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 16:04:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:04:07.642635 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2100e43-c5c7-4380-b872-9dc293b77a61 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:04:07.643062 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2100e43-c5c7-4380-b872-9dc293b77a61 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:04:07.643183 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2100e43-c5c7-4380-b872-9dc293b77a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:04:07.664154 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-a2100e43-c5c7-4380-b872-9dc293b77a61 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:04:07.665824 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-a2100e43-c5c7-4380-b872-9dc293b77a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:04:07.673703 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 482/955] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 16:04:07 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:04:08.016152 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de03b6-697e-41a2-859b-a7f08505b259 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:04:08.021620 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=65 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:04:08.027603 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de03b6-697e-41a2-859b-a7f08505b259 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:04:08.031089 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cf6d69-e11e-4654-a07e-4e8ae860dfea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5593ee9d30b4b65a215a4fe8dfba060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:04:08.031681 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf6d69-e11e-4654-a07e-4e8ae860dfea service neutron] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:04:08.033152 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf6d69-e11e-4654-a07e-4e8ae860dfea service neutron] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:04:08.033152 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf6d69-e11e-4654-a07e-4e8ae860dfea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:04:08.041639 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cf6d69-e11e-4654-a07e-4e8ae860dfea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:04:08.043067 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cf6d69-e11e-4654-a07e-4e8ae860dfea service neutron] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:04:08.052962 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 474/956] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:04:08 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:04:10.925138 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef6a40b-57f3-4b47-b213-d35557c8fded None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:04:10.925734 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef6a40b-57f3-4b47-b213-d35557c8fded None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:04:10.925734 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef6a40b-57f3-4b47-b213-d35557c8fded None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:04:10.927001 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 483/957] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 16:04:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:04:10.932945 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f72fcb-b2f7-4331-bd5a-1a33e4c9a7e0 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:04:10.933342 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f72fcb-b2f7-4331-bd5a-1a33e4c9a7e0 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:04:10.933488 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f72fcb-b2f7-4331-bd5a-1a33e4c9a7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:04:10.952492 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-20f72fcb-b2f7-4331-bd5a-1a33e4c9a7e0 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:04:10.953710 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-20f72fcb-b2f7-4331-bd5a-1a33e4c9a7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:04:10.961876 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 475/958] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 16:04:10 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:04:11.309339 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef6a40b-57f3-4b47-b213-d35557c8fded None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:04:11.320123 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef6a40b-57f3-4b47-b213-d35557c8fded None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:04:11.323843 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d038548-f77c-40ca-97c2-a3b84fccb829 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5593ee9d30b4b65a215a4fe8dfba060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:04:11.324452 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d038548-f77c-40ca-97c2-a3b84fccb829 service neutron] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:04:11.324731 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d038548-f77c-40ca-97c2-a3b84fccb829 service neutron] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:04:11.330064 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d038548-f77c-40ca-97c2-a3b84fccb829 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:04:11.333979 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d038548-f77c-40ca-97c2-a3b84fccb829 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:04:11.335461 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d038548-f77c-40ca-97c2-a3b84fccb829 service neutron] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:04:11.345013 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 484/959] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:04:11 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:04:15.695924 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fefa1-c7cc-4d73-a4e8-612180b57912 None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:04:15.696479 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fefa1-c7cc-4d73-a4e8-612180b57912 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:04:15.696593 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fefa1-c7cc-4d73-a4e8-612180b57912 None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:04:15.697884 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 476/960] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 16:04:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:04:15.703234 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947c501-0529-446e-8f98-4fce8199f69b None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:04:15.703645 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947c501-0529-446e-8f98-4fce8199f69b None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:04:15.703778 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947c501-0529-446e-8f98-4fce8199f69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:04:15.723078 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-c947c501-0529-446e-8f98-4fce8199f69b None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:04:15.724256 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-c947c501-0529-446e-8f98-4fce8199f69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:04:15.732467 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 485/961] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 16:04:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:04:16.087457 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87457cf0-6d7b-4a60-9f8e-8fd7f05dc7c7 None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:04:16.087457 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87457cf0-6d7b-4a60-9f8e-8fd7f05dc7c7 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:04:16.087726 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87457cf0-6d7b-4a60-9f8e-8fd7f05dc7c7 None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:04:16.089356 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 477/962] 10.222.0.70 () {54 vars in 965 bytes} [Fri Aug 19 16:04:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:04:16.098466 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487bf5e-3f25-41bb-a1be-904f48545603 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:04:16.098777 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487bf5e-3f25-41bb-a1be-904f48545603 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:04:16.099047 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487bf5e-3f25-41bb-a1be-904f48545603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:04:16.118581 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-4487bf5e-3f25-41bb-a1be-904f48545603 None None] MFA Rules not processed for user `f5593ee9d30b4b65a215a4fe8dfba060`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:04:16.119764 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-4487bf5e-3f25-41bb-a1be-904f48545603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:04:16.126242 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 486/963] 10.222.0.70 () {58 vars in 1062 bytes} [Fri Aug 19 16:04:16 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:04:16.135641 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87457cf0-6d7b-4a60-9f8e-8fd7f05dc7c7 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:04:16.146299 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87457cf0-6d7b-4a60-9f8e-8fd7f05dc7c7 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:04:16.150514 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fea325-c4a5-4166-9168-5a278f167fef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5593ee9d30b4b65a215a4fe8dfba060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:04:16.151108 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fea325-c4a5-4166-9168-5a278f167fef service neutron] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:04:16.151381 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fea325-c4a5-4166-9168-5a278f167fef service neutron] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:04:16.151649 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fea325-c4a5-4166-9168-5a278f167fef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:04:16.160603 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fea325-c4a5-4166-9168-5a278f167fef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:04:16.162036 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fea325-c4a5-4166-9168-5a278f167fef service neutron] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:04:16.171948 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 478/964] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:04:16 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:04:19.901698 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bffb6f-df60-468f-adea-608614005983 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:04:19.902257 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bffb6f-df60-468f-adea-608614005983 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:04:19.902257 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bffb6f-df60-468f-adea-608614005983 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:04:19.903560 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 487/965] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 16:04:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:04:19.908894 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d6db7-59e1-4e8c-a5e4-24824547cb34 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:04:19.909352 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d6db7-59e1-4e8c-a5e4-24824547cb34 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:04:19.909584 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d6db7-59e1-4e8c-a5e4-24824547cb34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:04:19.928404 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-6d1d6db7-59e1-4e8c-a5e4-24824547cb34 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:04:19.930379 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-6d1d6db7-59e1-4e8c-a5e4-24824547cb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:04:19.938180 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 479/966] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 16:04:19 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:04:20.285535 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bffb6f-df60-468f-adea-608614005983 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:04:20.296733 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bffb6f-df60-468f-adea-608614005983 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:04:20.300182 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1933d-fc96-484a-8862-646640543edb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5593ee9d30b4b65a215a4fe8dfba060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:04:20.300796 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1933d-fc96-484a-8862-646640543edb service neutron] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:04:20.301077 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1933d-fc96-484a-8862-646640543edb service neutron] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:04:20.301343 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1933d-fc96-484a-8862-646640543edb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:04:20.311497 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f1933d-fc96-484a-8862-646640543edb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:04:20.312941 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f1933d-fc96-484a-8862-646640543edb service neutron] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:04:20.322731 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 488/967] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:04:20 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:04:25.005525 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822a602-1d4a-4571-b0a1-349d1062ddc7 None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:04:25.006072 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822a602-1d4a-4571-b0a1-349d1062ddc7 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:04:25.006072 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822a602-1d4a-4571-b0a1-349d1062ddc7 None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:04:25.008007 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 480/968] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 16:04:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:04:25.013203 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0640f18-b5c6-4815-ba37-6a073bec4663 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:04:25.013620 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0640f18-b5c6-4815-ba37-6a073bec4663 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:04:25.013750 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0640f18-b5c6-4815-ba37-6a073bec4663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:04:25.033916 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-d0640f18-b5c6-4815-ba37-6a073bec4663 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:04:25.035114 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-d0640f18-b5c6-4815-ba37-6a073bec4663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:04:25.043120 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 489/969] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 16:04:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:04:25.385393 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b822a602-1d4a-4571-b0a1-349d1062ddc7 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:04:25.395863 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b822a602-1d4a-4571-b0a1-349d1062ddc7 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:04:25.399471 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679c7d2-1819-4272-8f81-c67a109dd207 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5593ee9d30b4b65a215a4fe8dfba060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:04:25.399975 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679c7d2-1819-4272-8f81-c67a109dd207 service neutron] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:04:25.400256 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679c7d2-1819-4272-8f81-c67a109dd207 service neutron] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:04:25.400527 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679c7d2-1819-4272-8f81-c67a109dd207 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:04:25.409811 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5679c7d2-1819-4272-8f81-c67a109dd207 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:04:25.411252 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5679c7d2-1819-4272-8f81-c67a109dd207 service neutron] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:04:25.421174 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 481/970] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:04:25 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:04:30.903857 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46ac79-ba1d-4791-a61f-67a7fece3697 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:04:30.904349 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46ac79-ba1d-4791-a61f-67a7fece3697 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:04:30.904349 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46ac79-ba1d-4791-a61f-67a7fece3697 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:04:30.906028 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 490/971] 10.222.0.70 () {54 vars in 921 bytes} [Fri Aug 19 16:04:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:04:30.911316 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686097c6-1a98-4188-a44a-9a7d78fa58c2 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:04:30.911737 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686097c6-1a98-4188-a44a-9a7d78fa58c2 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:04:30.911850 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686097c6-1a98-4188-a44a-9a7d78fa58c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:04:30.964914 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-686097c6-1a98-4188-a44a-9a7d78fa58c2 None None] MFA Rules not processed for user `580372230aad44269e3e0a7b230533f2`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:04:30.966459 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-686097c6-1a98-4188-a44a-9a7d78fa58c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:04:31.047490 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 482/972] 10.222.0.70 () {58 vars in 1018 bytes} [Fri Aug 19 16:04:30 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:04:35.028978 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=25 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:04:35.485278 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f6fa2-1fb7-47f5-8d3c-399f29d22709 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:04:35.485840 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f6fa2-1fb7-47f5-8d3c-399f29d22709 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:04:35.486331 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f6fa2-1fb7-47f5-8d3c-399f29d22709 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:04:35.488571 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 491/973] 10.222.0.70 () {54 vars in 921 bytes} [Fri Aug 19 16:04:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:04:35.495049 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccda628-c7da-4582-bf9f-1c5be695735b None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:04:35.495506 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccda628-c7da-4582-bf9f-1c5be695735b None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:04:35.495755 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccda628-c7da-4582-bf9f-1c5be695735b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:04:35.518394 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-3ccda628-c7da-4582-bf9f-1c5be695735b None None] MFA Rules not processed for user `580372230aad44269e3e0a7b230533f2`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:04:35.519579 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-3ccda628-c7da-4582-bf9f-1c5be695735b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:04:35.529039 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 483/974] 10.222.0.70 () {58 vars in 1018 bytes} [Fri Aug 19 16:04:35 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:04:37.210705 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfe636-40b5-4d09-9245-12ab0e3e8d03 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:04:37.211253 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfe636-40b5-4d09-9245-12ab0e3e8d03 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:04:37.211346 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfe636-40b5-4d09-9245-12ab0e3e8d03 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:04:37.212812 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 492/975] 10.222.0.70 () {54 vars in 921 bytes} [Fri Aug 19 16:04:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:04:37.218571 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0403476-be58-4be4-88d0-120deafcda5c None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:04:37.219014 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0403476-be58-4be4-88d0-120deafcda5c None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:04:37.219290 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0403476-be58-4be4-88d0-120deafcda5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:04:37.238733 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-a0403476-be58-4be4-88d0-120deafcda5c None None] MFA Rules not processed for user `580372230aad44269e3e0a7b230533f2`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:04:37.240159 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-a0403476-be58-4be4-88d0-120deafcda5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:04:37.249652 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 484/976] 10.222.0.70 () {58 vars in 1018 bytes} [Fri Aug 19 16:04:37 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:04:41.195895 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91073c93-f340-4684-bb69-26d7c0ff7637 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:04:41.196435 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91073c93-f340-4684-bb69-26d7c0ff7637 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:04:41.196435 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91073c93-f340-4684-bb69-26d7c0ff7637 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:04:41.201854 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 493/977] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 16:04:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:04:41.204526 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375f099-9f95-4333-827a-d684cc1f34da None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:04:41.205351 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375f099-9f95-4333-827a-d684cc1f34da None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:04:41.205866 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375f099-9f95-4333-827a-d684cc1f34da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:04:41.217999 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=69 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:04:41.232242 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-9375f099-9f95-4333-827a-d684cc1f34da None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:04:41.235380 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-9375f099-9f95-4333-827a-d684cc1f34da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:04:41.248086 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 485/978] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 16:04:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:04:41.627605 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ef2b4-3d6c-4d6d-bf9f-cb00e97354b8 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:04:41.628934 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ef2b4-3d6c-4d6d-bf9f-cb00e97354b8 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:04:41.628934 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ef2b4-3d6c-4d6d-bf9f-cb00e97354b8 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:04:41.630859 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 494/979] 10.222.0.70 () {54 vars in 962 bytes} [Fri Aug 19 16:04:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:04:41.637353 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879852b-8657-459a-acd4-88255704f385 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:04:41.637927 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879852b-8657-459a-acd4-88255704f385 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:04:41.638452 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879852b-8657-459a-acd4-88255704f385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:04:41.694559 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-b879852b-8657-459a-acd4-88255704f385 None None] MFA Rules not processed for user `d90cec9e3ff64b5aa4cc867895b996ad`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:04:41.695875 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-b879852b-8657-459a-acd4-88255704f385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:04:41.779502 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 486/980] 10.222.0.70 () {58 vars in 1059 bytes} [Fri Aug 19 16:04:41 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:04:41.788285 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ef2b4-3d6c-4d6d-bf9f-cb00e97354b8 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:04:41.803815 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ef2b4-3d6c-4d6d-bf9f-cb00e97354b8 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:04:41.810257 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d560a5f8-f87e-4c4e-9fdb-7afb601b387f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd90cec9e3ff64b5aa4cc867895b996ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:04:41.810257 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560a5f8-f87e-4c4e-9fdb-7afb601b387f service nova] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:04:41.810257 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560a5f8-f87e-4c4e-9fdb-7afb601b387f service nova] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:04:41.810257 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560a5f8-f87e-4c4e-9fdb-7afb601b387f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:04:41.819081 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d560a5f8-f87e-4c4e-9fdb-7afb601b387f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:04:41.820955 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d560a5f8-f87e-4c4e-9fdb-7afb601b387f service nova] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:04:41.830880 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 495/981] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:04:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:04:44.269860 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d45d00-07f8-49b1-a70a-152c2823e0d3 None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:04:44.270425 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d45d00-07f8-49b1-a70a-152c2823e0d3 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:04:44.270425 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d45d00-07f8-49b1-a70a-152c2823e0d3 None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:04:44.276327 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 487/982] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 16:04:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:04:44.278033 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed517f-8008-49cf-a20c-299747752a46 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:04:44.278821 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed517f-8008-49cf-a20c-299747752a46 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:04:44.279247 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed517f-8008-49cf-a20c-299747752a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:04:44.302470 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-a8ed517f-8008-49cf-a20c-299747752a46 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:04:44.304449 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-a8ed517f-8008-49cf-a20c-299747752a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:04:44.319910 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 496/983] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 16:04:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:04:44.664707 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d45d00-07f8-49b1-a70a-152c2823e0d3 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:04:44.678914 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d45d00-07f8-49b1-a70a-152c2823e0d3 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:04:44.684766 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6420ab-92d1-471b-baf2-e6e7cea93f7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd90cec9e3ff64b5aa4cc867895b996ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:04:44.685446 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6420ab-92d1-471b-baf2-e6e7cea93f7d service nova] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:04:44.685799 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6420ab-92d1-471b-baf2-e6e7cea93f7d service nova] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:04:44.686145 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6420ab-92d1-471b-baf2-e6e7cea93f7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:04:44.695418 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6420ab-92d1-471b-baf2-e6e7cea93f7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:04:44.697154 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6420ab-92d1-471b-baf2-e6e7cea93f7d service nova] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:04:44.707142 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 488/984] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:04:44 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:04:47.449448 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a7e90-8ecc-4339-8bc1-148e46c4fb19 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:04:47.450348 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a7e90-8ecc-4339-8bc1-148e46c4fb19 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:04:47.450630 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a7e90-8ecc-4339-8bc1-148e46c4fb19 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:04:47.451967 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 497/985] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 16:04:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:04:47.457416 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169600d7-d3ba-49ff-bf37-ce6a323dc6e9 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:04:47.457874 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169600d7-d3ba-49ff-bf37-ce6a323dc6e9 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:04:47.457990 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169600d7-d3ba-49ff-bf37-ce6a323dc6e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:04:47.478554 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-169600d7-d3ba-49ff-bf37-ce6a323dc6e9 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:04:47.479962 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-169600d7-d3ba-49ff-bf37-ce6a323dc6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:04:47.489444 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 489/986] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 16:04:47 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:04:47.851012 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ff7e7-de28-43fc-930a-36394ad91139 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:04:47.851287 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ff7e7-de28-43fc-930a-36394ad91139 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:04:47.851862 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ff7e7-de28-43fc-930a-36394ad91139 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:04:47.852959 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 498/987] 10.222.0.70 () {54 vars in 962 bytes} [Fri Aug 19 16:04:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:04:47.861919 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ad06f-f353-4ac5-a40b-b6875dfd24a3 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:04:47.867908 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ad06f-f353-4ac5-a40b-b6875dfd24a3 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:04:47.867908 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ad06f-f353-4ac5-a40b-b6875dfd24a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:04:47.882744 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-204ad06f-f353-4ac5-a40b-b6875dfd24a3 None None] MFA Rules not processed for user `d90cec9e3ff64b5aa4cc867895b996ad`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:04:47.885207 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-204ad06f-f353-4ac5-a40b-b6875dfd24a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:04:47.898494 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 490/988] 10.222.0.70 () {58 vars in 1059 bytes} [Fri Aug 19 16:04:47 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:04:47.906377 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ff7e7-de28-43fc-930a-36394ad91139 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:04:47.922566 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ff7e7-de28-43fc-930a-36394ad91139 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:04:47.928406 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c8a52-4215-4bb4-937b-2d858af96db2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd90cec9e3ff64b5aa4cc867895b996ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:04:47.929255 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c8a52-4215-4bb4-937b-2d858af96db2 service nova] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:04:47.929528 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c8a52-4215-4bb4-937b-2d858af96db2 service nova] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:04:47.930139 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c8a52-4215-4bb4-937b-2d858af96db2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:04:47.939936 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640c8a52-4215-4bb4-937b-2d858af96db2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:04:47.942033 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640c8a52-4215-4bb4-937b-2d858af96db2 service nova] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:04:47.957946 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 499/989] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:04:47 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:04:50.873951 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee63938-e8c2-4cbd-a9aa-fd98fa90fe34 None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:04:50.874884 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee63938-e8c2-4cbd-a9aa-fd98fa90fe34 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:04:50.875394 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee63938-e8c2-4cbd-a9aa-fd98fa90fe34 None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:04:50.876982 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 491/990] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 16:04:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:04:50.883405 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2b945-fa95-4c3f-9d85-7423fb37e172 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:04:50.884256 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2b945-fa95-4c3f-9d85-7423fb37e172 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:04:50.884769 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2b945-fa95-4c3f-9d85-7423fb37e172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:04:50.906463 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-8ff2b945-fa95-4c3f-9d85-7423fb37e172 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:04:50.908056 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-8ff2b945-fa95-4c3f-9d85-7423fb37e172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:04:50.917383 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 500/991] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 16:04:50 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:04:51.283704 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee63938-e8c2-4cbd-a9aa-fd98fa90fe34 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:04:51.301545 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee63938-e8c2-4cbd-a9aa-fd98fa90fe34 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:04:51.307227 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26154aa3-bc0c-4cb0-bde3-f942de4536a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd90cec9e3ff64b5aa4cc867895b996ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:04:51.307880 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26154aa3-bc0c-4cb0-bde3-f942de4536a3 service nova] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:04:51.308183 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26154aa3-bc0c-4cb0-bde3-f942de4536a3 service nova] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:04:51.308456 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26154aa3-bc0c-4cb0-bde3-f942de4536a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:04:51.319607 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26154aa3-bc0c-4cb0-bde3-f942de4536a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:04:51.321600 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26154aa3-bc0c-4cb0-bde3-f942de4536a3 service nova] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:04:51.344244 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 492/992] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:04:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:04:51.445887 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783d4a3-ac86-4580-88e2-94ac1839796d None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:04:51.445887 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783d4a3-ac86-4580-88e2-94ac1839796d None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:04:51.445887 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783d4a3-ac86-4580-88e2-94ac1839796d None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:04:51.447160 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 501/993] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 16:04:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:04:51.452793 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c05b5-e3b9-463e-8a6d-8ce2c1094066 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:04:51.453082 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c05b5-e3b9-463e-8a6d-8ce2c1094066 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:04:51.453358 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c05b5-e3b9-463e-8a6d-8ce2c1094066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:04:51.516212 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-861c05b5-e3b9-463e-8a6d-8ce2c1094066 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:04:51.517060 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-861c05b5-e3b9-463e-8a6d-8ce2c1094066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:04:51.529153 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 493/994] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 16:04:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:04:52.160928 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ab5bc-fa7e-4492-a978-5632c8ba0edb None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:04:52.161458 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ab5bc-fa7e-4492-a978-5632c8ba0edb None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:04:52.161675 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ab5bc-fa7e-4492-a978-5632c8ba0edb None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:04:52.163368 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 502/995] 10.222.0.70 () {54 vars in 964 bytes} [Fri Aug 19 16:04:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:04:52.168728 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e927999-56dc-40aa-ab43-724d58b93df4 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:04:52.169212 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e927999-56dc-40aa-ab43-724d58b93df4 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:04:52.169310 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e927999-56dc-40aa-ab43-724d58b93df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:04:52.229555 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-7e927999-56dc-40aa-ab43-724d58b93df4 None None] MFA Rules not processed for user `92eb2988fd86400dacb28eeef921a4b8`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:04:52.230785 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-7e927999-56dc-40aa-ab43-724d58b93df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:04:52.280783 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:04:52.298065 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 494/996] 10.222.0.70 () {58 vars in 1061 bytes} [Fri Aug 19 16:04:52 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:04:52.306073 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ab5bc-fa7e-4492-a978-5632c8ba0edb None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:04:52.316934 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ab5bc-fa7e-4492-a978-5632c8ba0edb None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:04:52.321061 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57342d1a-162e-43a9-8ef5-89e659f36653 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92eb2988fd86400dacb28eeef921a4b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:04:52.321646 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57342d1a-162e-43a9-8ef5-89e659f36653 service cinder] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:04:52.321918 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57342d1a-162e-43a9-8ef5-89e659f36653 service cinder] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:04:52.322185 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57342d1a-162e-43a9-8ef5-89e659f36653 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:04:52.331283 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57342d1a-162e-43a9-8ef5-89e659f36653 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:04:52.332718 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57342d1a-162e-43a9-8ef5-89e659f36653 service cinder] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:04:52.342732 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 503/997] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:04:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:04:53.844866 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc5ac5-f14e-4707-86c6-a5ed89a7fa7f None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:04:53.845435 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc5ac5-f14e-4707-86c6-a5ed89a7fa7f None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:04:53.845435 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc5ac5-f14e-4707-86c6-a5ed89a7fa7f None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:04:53.846990 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 495/998] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 16:04:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:04:53.853646 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be0a04-2378-46f1-9ba4-faf5ef504d1f None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:04:53.854199 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be0a04-2378-46f1-9ba4-faf5ef504d1f None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:04:53.854199 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be0a04-2378-46f1-9ba4-faf5ef504d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:04:53.878403 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-36be0a04-2378-46f1-9ba4-faf5ef504d1f None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:04:53.879827 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-36be0a04-2378-46f1-9ba4-faf5ef504d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:04:53.889467 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 504/999] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 16:04:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:04:54.256139 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc5ac5-f14e-4707-86c6-a5ed89a7fa7f None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:04:54.270550 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc5ac5-f14e-4707-86c6-a5ed89a7fa7f None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:04:54.275912 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3b8a5-1aa2-4e90-8005-735f5c14ac44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd90cec9e3ff64b5aa4cc867895b996ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:04:54.276546 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3b8a5-1aa2-4e90-8005-735f5c14ac44 service nova] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:04:54.276861 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3b8a5-1aa2-4e90-8005-735f5c14ac44 service nova] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:04:54.277131 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3b8a5-1aa2-4e90-8005-735f5c14ac44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:04:54.286881 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a3b8a5-1aa2-4e90-8005-735f5c14ac44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:04:54.288471 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a3b8a5-1aa2-4e90-8005-735f5c14ac44 service nova] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:04:54.299222 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 496/1000] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:04:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:04:56.727280 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f13001-4ad6-49b5-acde-52f512566bb0 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:04:56.727836 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f13001-4ad6-49b5-acde-52f512566bb0 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:04:56.727836 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f13001-4ad6-49b5-acde-52f512566bb0 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:04:56.729183 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 505/1001] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 16:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:04:56.734551 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5b41b-65ba-4bd2-bef1-746915366d6d None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:04:56.734980 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5b41b-65ba-4bd2-bef1-746915366d6d None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:04:56.735163 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5b41b-65ba-4bd2-bef1-746915366d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:04:56.758366 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-ffc5b41b-65ba-4bd2-bef1-746915366d6d None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:04:56.759573 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-ffc5b41b-65ba-4bd2-bef1-746915366d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:04:56.768700 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 497/1002] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 16:04:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:04:57.119293 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f13001-4ad6-49b5-acde-52f512566bb0 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:04:57.133107 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f13001-4ad6-49b5-acde-52f512566bb0 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:04:57.138082 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95abf2-9dd3-4964-9ba2-e197c13a34d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd90cec9e3ff64b5aa4cc867895b996ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:04:57.138741 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95abf2-9dd3-4964-9ba2-e197c13a34d3 service nova] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:04:57.139076 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95abf2-9dd3-4964-9ba2-e197c13a34d3 service nova] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:04:57.139353 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95abf2-9dd3-4964-9ba2-e197c13a34d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:04:57.147660 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a95abf2-9dd3-4964-9ba2-e197c13a34d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:04:57.149277 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a95abf2-9dd3-4964-9ba2-e197c13a34d3 service nova] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:04:57.158927 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 506/1003] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:04:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:04:59.530710 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f1751-8d52-42c2-8ca5-b9bc07784c98 None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:04:59.531229 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f1751-8d52-42c2-8ca5-b9bc07784c98 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:04:59.531229 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f1751-8d52-42c2-8ca5-b9bc07784c98 None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:04:59.532772 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 498/1004] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 16:04:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:04:59.538226 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b56b7-2a63-4af5-9cbc-6b9bffde08e9 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:04:59.538620 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b56b7-2a63-4af5-9cbc-6b9bffde08e9 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:04:59.538755 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b56b7-2a63-4af5-9cbc-6b9bffde08e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:04:59.558398 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-407b56b7-2a63-4af5-9cbc-6b9bffde08e9 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:04:59.559591 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-407b56b7-2a63-4af5-9cbc-6b9bffde08e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:04:59.567954 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 507/1005] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 16:04:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:04:59.917774 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f1751-8d52-42c2-8ca5-b9bc07784c98 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:04:59.932234 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f1751-8d52-42c2-8ca5-b9bc07784c98 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:04:59.937569 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324f607-d9b1-4fb7-bacf-5209d4878cd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd90cec9e3ff64b5aa4cc867895b996ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:04:59.938234 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324f607-d9b1-4fb7-bacf-5209d4878cd8 service nova] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:04:59.938578 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324f607-d9b1-4fb7-bacf-5209d4878cd8 service nova] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:04:59.938913 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324f607-d9b1-4fb7-bacf-5209d4878cd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:04:59.948023 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2324f607-d9b1-4fb7-bacf-5209d4878cd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:04:59.949718 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2324f607-d9b1-4fb7-bacf-5209d4878cd8 service nova] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:04:59.960541 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 499/1006] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:04:59 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:05:02.558509 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e3422-90c5-495a-a2de-b522396bb326 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:02.580069 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e3422-90c5-495a-a2de-b522396bb326 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:02.580069 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e3422-90c5-495a-a2de-b522396bb326 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:02.580069 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 508/1007] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 16:05:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:05:02.580503 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccdba72-7ace-4f94-b5fb-c531cdd568e8 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:02.580503 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccdba72-7ace-4f94-b5fb-c531cdd568e8 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:02.580503 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccdba72-7ace-4f94-b5fb-c531cdd568e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:02.590447 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-3ccdba72-7ace-4f94-b5fb-c531cdd568e8 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:05:02.591651 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-3ccdba72-7ace-4f94-b5fb-c531cdd568e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:05:02.602223 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 500/1008] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 16:05:02 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:05:03.058544 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e3422-90c5-495a-a2de-b522396bb326 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:05:03.058544 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e3422-90c5-495a-a2de-b522396bb326 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:05:03.058544 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e728b2-6f83-4099-a114-130bf3d59495 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd90cec9e3ff64b5aa4cc867895b996ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:05:03.058544 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e728b2-6f83-4099-a114-130bf3d59495 service nova] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:03.059446 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e728b2-6f83-4099-a114-130bf3d59495 service nova] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:03.059446 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e728b2-6f83-4099-a114-130bf3d59495 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:03.059446 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e728b2-6f83-4099-a114-130bf3d59495 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:05:03.059446 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e728b2-6f83-4099-a114-130bf3d59495 service nova] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:05:03.059446 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 509/1009] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:05:02 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:05:06.337732 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20d8fd-7d44-4f8a-b597-9b6600b735b7 None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:06.338585 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20d8fd-7d44-4f8a-b597-9b6600b735b7 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:06.338585 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20d8fd-7d44-4f8a-b597-9b6600b735b7 None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:06.339596 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 501/1010] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 16:05:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:05:06.344839 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582535c-f19a-42ed-950a-a0fcd2feb5ec None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:06.345357 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582535c-f19a-42ed-950a-a0fcd2feb5ec None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:06.345357 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582535c-f19a-42ed-950a-a0fcd2feb5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:06.356089 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=43 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:05:06.366436 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-5582535c-f19a-42ed-950a-a0fcd2feb5ec None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:05:06.367688 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-5582535c-f19a-42ed-950a-a0fcd2feb5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:05:06.376091 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 510/1011] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 16:05:06 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:05:06.727539 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d20d8fd-7d44-4f8a-b597-9b6600b735b7 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:05:06.742076 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d20d8fd-7d44-4f8a-b597-9b6600b735b7 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:05:06.748149 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f3e6a-aa7d-44d6-9161-290ca965f979 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd90cec9e3ff64b5aa4cc867895b996ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:05:06.749547 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f3e6a-aa7d-44d6-9161-290ca965f979 service nova] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:06.749547 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f3e6a-aa7d-44d6-9161-290ca965f979 service nova] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:06.749547 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f3e6a-aa7d-44d6-9161-290ca965f979 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:06.759056 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28f3e6a-aa7d-44d6-9161-290ca965f979 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:05:06.760620 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28f3e6a-aa7d-44d6-9161-290ca965f979 service nova] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:05:06.770898 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 502/1012] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:05:06 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:05:08.819160 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f0457-4e6a-4e09-b9c6-623750a761d8 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:08.819775 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f0457-4e6a-4e09-b9c6-623750a761d8 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:08.819775 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f0457-4e6a-4e09-b9c6-623750a761d8 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:08.821142 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 511/1013] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 16:05:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:05:08.826498 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ecb00-632c-4204-b055-071ea30eec40 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:08.826942 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ecb00-632c-4204-b055-071ea30eec40 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:08.827080 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ecb00-632c-4204-b055-071ea30eec40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:08.846041 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-ee0ecb00-632c-4204-b055-071ea30eec40 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:05:08.847223 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-ee0ecb00-632c-4204-b055-071ea30eec40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:05:08.855144 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 503/1014] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 16:05:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:05:09.216077 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e575b-1d92-4c8d-a9df-0c941281cc42 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:09.216356 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e575b-1d92-4c8d-a9df-0c941281cc42 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:09.216526 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e575b-1d92-4c8d-a9df-0c941281cc42 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:09.217868 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 512/1015] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 16:05:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:05:09.223806 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a808e8-29ff-4194-835e-518f8a4a8ff7 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:09.224263 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a808e8-29ff-4194-835e-518f8a4a8ff7 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:09.224534 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a808e8-29ff-4194-835e-518f8a4a8ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:09.227152 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ced408-1059-44ca-88b5-b3d3006421af None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:09.227498 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ced408-1059-44ca-88b5-b3d3006421af None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:09.227837 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ced408-1059-44ca-88b5-b3d3006421af None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:09.229219 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 513/1016] 10.222.0.70 () {54 vars in 967 bytes} [Fri Aug 19 16:05:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 16:05:09.233938 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db0671-ea49-4698-84f2-d68d24beb140 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:09.238360 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db0671-ea49-4698-84f2-d68d24beb140 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:09.238360 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db0671-ea49-4698-84f2-d68d24beb140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:09.246469 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-b4a808e8-29ff-4194-835e-518f8a4a8ff7 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:05:09.247669 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-b4a808e8-29ff-4194-835e-518f8a4a8ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:05:09.256350 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 504/1017] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 16:05:09 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:05:09.286150 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-11db0671-ea49-4698-84f2-d68d24beb140 None None] MFA Rules not processed for user `3d70aff7f0a448bb9a5cc2b78c828590`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:05:09.287415 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-11db0671-ea49-4698-84f2-d68d24beb140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:05:09.351817 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 514/1018] 10.222.0.70 () {58 vars in 1064 bytes} [Fri Aug 19 16:05:09 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:05:09.359556 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a808e8-29ff-4194-835e-518f8a4a8ff7 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:05:09.369299 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a808e8-29ff-4194-835e-518f8a4a8ff7 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:05:09.372823 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ddd17-81e2-44fe-b665-86a3be8500b2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d70aff7f0a448bb9a5cc2b78c828590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:05:09.373418 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ddd17-81e2-44fe-b665-86a3be8500b2 service glance] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:09.373688 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ddd17-81e2-44fe-b665-86a3be8500b2 service glance] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:09.373954 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ddd17-81e2-44fe-b665-86a3be8500b2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:09.383407 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750ddd17-81e2-44fe-b665-86a3be8500b2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:05:09.384860 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750ddd17-81e2-44fe-b665-86a3be8500b2 service glance] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:05:09.394127 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 505/1019] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:05:09 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:05:09.612340 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db0671-ea49-4698-84f2-d68d24beb140 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:05:09.625449 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db0671-ea49-4698-84f2-d68d24beb140 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:05:09.632537 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f49a52-e29a-443f-af63-c3f421affd1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd90cec9e3ff64b5aa4cc867895b996ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:05:09.632537 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f49a52-e29a-443f-af63-c3f421affd1d service nova] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:09.632537 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f49a52-e29a-443f-af63-c3f421affd1d service nova] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:09.632537 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f49a52-e29a-443f-af63-c3f421affd1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:09.640220 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f49a52-e29a-443f-af63-c3f421affd1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:05:09.641838 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f49a52-e29a-443f-af63-c3f421affd1d service nova] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:05:09.651520 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 515/1020] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:05:09 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:05:12.129755 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d6384-0044-4738-956c-b0b0823b73ee None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:12.131086 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d6384-0044-4738-956c-b0b0823b73ee None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:12.131344 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d6384-0044-4738-956c-b0b0823b73ee None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:12.132849 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 506/1021] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 16:05:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:05:12.138486 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2c9f7-ee07-481e-8d9d-d5631879667b None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:12.138973 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2c9f7-ee07-481e-8d9d-d5631879667b None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:12.139082 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2c9f7-ee07-481e-8d9d-d5631879667b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:12.158768 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-afb2c9f7-ee07-481e-8d9d-d5631879667b None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:05:12.160259 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-afb2c9f7-ee07-481e-8d9d-d5631879667b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:05:12.176965 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 516/1022] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 16:05:12 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:05:12.529162 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d6384-0044-4738-956c-b0b0823b73ee None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:05:12.543509 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d6384-0044-4738-956c-b0b0823b73ee None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:05:12.548495 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab8ed9-b65c-4bc1-b425-ddbdcacb184f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd90cec9e3ff64b5aa4cc867895b996ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:05:12.549125 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab8ed9-b65c-4bc1-b425-ddbdcacb184f service nova] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:12.549431 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab8ed9-b65c-4bc1-b425-ddbdcacb184f service nova] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:12.549697 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab8ed9-b65c-4bc1-b425-ddbdcacb184f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:12.562183 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab8ed9-b65c-4bc1-b425-ddbdcacb184f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:05:12.563771 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab8ed9-b65c-4bc1-b425-ddbdcacb184f service nova] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:05:12.574985 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 507/1023] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:05:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:05:15.049475 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ababde0-db60-4604-9650-6bf7529271bc None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:15.050106 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ababde0-db60-4604-9650-6bf7529271bc None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:15.050106 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ababde0-db60-4604-9650-6bf7529271bc None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:15.051542 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 517/1024] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 16:05:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 16:05:15.057038 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232a006-7f6c-47ec-86f5-fee7a9ec6893 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:15.057501 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232a006-7f6c-47ec-86f5-fee7a9ec6893 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:15.057600 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232a006-7f6c-47ec-86f5-fee7a9ec6893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:15.077434 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-6232a006-7f6c-47ec-86f5-fee7a9ec6893 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:05:15.079343 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-6232a006-7f6c-47ec-86f5-fee7a9ec6893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:05:15.088293 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 508/1025] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 16:05:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:05:15.442183 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ababde0-db60-4604-9650-6bf7529271bc None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:05:15.456526 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ababde0-db60-4604-9650-6bf7529271bc None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:05:15.462343 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e27cf-6291-4649-b6be-abb19231022c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd90cec9e3ff64b5aa4cc867895b996ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:05:15.462941 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e27cf-6291-4649-b6be-abb19231022c service nova] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:15.463212 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e27cf-6291-4649-b6be-abb19231022c service nova] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:15.463478 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e27cf-6291-4649-b6be-abb19231022c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:15.471887 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e27cf-6291-4649-b6be-abb19231022c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:05:15.474368 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e27cf-6291-4649-b6be-abb19231022c service nova] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:05:15.484575 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 518/1026] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:05:15 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:05:25.072294 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=50 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:05:25.480074 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=55 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:05:25.511306 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01592531-af63-42f5-8131-dc5c1616fd51 None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:25.511536 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01592531-af63-42f5-8131-dc5c1616fd51 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:25.511819 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01592531-af63-42f5-8131-dc5c1616fd51 None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:25.513219 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 509/1027] 10.222.0.70 () {54 vars in 918 bytes} [Fri Aug 19 16:05:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:05:25.518380 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c68ab2-3b73-456f-bff9-eb4ff0f5b0ca None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:25.518661 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c68ab2-3b73-456f-bff9-eb4ff0f5b0ca None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:25.518931 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c68ab2-3b73-456f-bff9-eb4ff0f5b0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:25.539204 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-54c68ab2-3b73-456f-bff9-eb4ff0f5b0ca None None] MFA Rules not processed for user `580372230aad44269e3e0a7b230533f2`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:05:25.540382 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-54c68ab2-3b73-456f-bff9-eb4ff0f5b0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:05:25.548764 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 519/1028] 10.222.0.70 () {58 vars in 1015 bytes} [Fri Aug 19 16:05:25 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:05:25.562553 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168890d2-305c-46de-8955-dfd37e7e3f67 None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:25.562854 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168890d2-305c-46de-8955-dfd37e7e3f67 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:25.563126 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168890d2-305c-46de-8955-dfd37e7e3f67 None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:25.564429 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 510/1029] 10.222.0.70 () {54 vars in 918 bytes} [Fri Aug 19 16:05:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:05:25.569499 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e77055-639f-4187-ba12-6455fe7ecea3 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:25.569780 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e77055-639f-4187-ba12-6455fe7ecea3 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:25.570054 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e77055-639f-4187-ba12-6455fe7ecea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:25.589563 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-53e77055-639f-4187-ba12-6455fe7ecea3 None None] MFA Rules not processed for user `d90cec9e3ff64b5aa4cc867895b996ad`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:05:25.590743 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-53e77055-639f-4187-ba12-6455fe7ecea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:05:25.599150 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 520/1030] 10.222.0.70 () {58 vars in 1015 bytes} [Fri Aug 19 16:05:25 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:05:28.291566 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d2112-cde4-4441-b0f6-15cc5e6a863a None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:28.292150 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d2112-cde4-4441-b0f6-15cc5e6a863a None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:28.292150 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d2112-cde4-4441-b0f6-15cc5e6a863a None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:28.293456 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 511/1031] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 16:05:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:05:28.298576 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6ea69-0309-4197-8259-69241dd786b0 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:28.299053 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6ea69-0309-4197-8259-69241dd786b0 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:28.299158 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6ea69-0309-4197-8259-69241dd786b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:28.317799 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-e5c6ea69-0309-4197-8259-69241dd786b0 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:05:28.319113 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-e5c6ea69-0309-4197-8259-69241dd786b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:05:28.326885 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 521/1032] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 16:05:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:05:28.677960 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d2112-cde4-4441-b0f6-15cc5e6a863a None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:05:28.691139 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d2112-cde4-4441-b0f6-15cc5e6a863a None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:05:28.696939 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39da7f-3705-4f12-8604-48b8f26ab9da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd90cec9e3ff64b5aa4cc867895b996ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:05:28.697525 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39da7f-3705-4f12-8604-48b8f26ab9da service nova] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:28.697796 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39da7f-3705-4f12-8604-48b8f26ab9da service nova] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:28.698060 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39da7f-3705-4f12-8604-48b8f26ab9da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:28.706069 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a39da7f-3705-4f12-8604-48b8f26ab9da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:05:28.707621 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a39da7f-3705-4f12-8604-48b8f26ab9da service nova] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:05:28.717850 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 512/1033] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:05:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:05:29.671497 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a691c06-59d2-43e7-aa4a-9462b1272d71 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:29.672020 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a691c06-59d2-43e7-aa4a-9462b1272d71 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:29.672020 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a691c06-59d2-43e7-aa4a-9462b1272d71 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:29.673396 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 522/1034] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 16:05:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:05:29.678963 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d627ab6-c511-47a9-8e81-f22ec850b901 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:29.679371 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d627ab6-c511-47a9-8e81-f22ec850b901 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:29.679488 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d627ab6-c511-47a9-8e81-f22ec850b901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:29.699368 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-7d627ab6-c511-47a9-8e81-f22ec850b901 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:05:29.700565 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-7d627ab6-c511-47a9-8e81-f22ec850b901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:05:29.708349 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 513/1035] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 16:05:29 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:05:29.912708 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a691c06-59d2-43e7-aa4a-9462b1272d71 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:05:29.926065 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a691c06-59d2-43e7-aa4a-9462b1272d71 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:05:29.931399 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f236f-4f84-4209-ab02-7eb357199d04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd90cec9e3ff64b5aa4cc867895b996ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:05:29.931981 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f236f-4f84-4209-ab02-7eb357199d04 service nova] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:29.932256 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f236f-4f84-4209-ab02-7eb357199d04 service nova] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:29.932554 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f236f-4f84-4209-ab02-7eb357199d04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:29.940451 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3f236f-4f84-4209-ab02-7eb357199d04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:05:29.942063 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3f236f-4f84-4209-ab02-7eb357199d04 service nova] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:05:29.952084 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 523/1036] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:05:29 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:05:30.858412 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460775e-f60b-4d61-ac74-3c196b5e0a1d None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:30.858977 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460775e-f60b-4d61-ac74-3c196b5e0a1d None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:30.858977 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460775e-f60b-4d61-ac74-3c196b5e0a1d None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:30.860300 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 514/1037] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 16:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:05:30.865518 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716d6cf-aebe-4f26-bf59-849521e3fbc3 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:30.866115 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716d6cf-aebe-4f26-bf59-849521e3fbc3 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:30.866115 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716d6cf-aebe-4f26-bf59-849521e3fbc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:30.886377 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-8716d6cf-aebe-4f26-bf59-849521e3fbc3 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:05:30.887559 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-8716d6cf-aebe-4f26-bf59-849521e3fbc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:05:30.895240 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 524/1038] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 16:05:30 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:05:31.054276 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7460775e-f60b-4d61-ac74-3c196b5e0a1d None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:05:31.067804 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7460775e-f60b-4d61-ac74-3c196b5e0a1d None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:05:31.073479 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c0134-0777-417b-92fb-761801efa850 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd90cec9e3ff64b5aa4cc867895b996ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:05:31.074065 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c0134-0777-417b-92fb-761801efa850 service nova] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:31.074333 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c0134-0777-417b-92fb-761801efa850 service nova] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:31.074597 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c0134-0777-417b-92fb-761801efa850 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:31.082772 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5c0134-0777-417b-92fb-761801efa850 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:05:31.085043 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5c0134-0777-417b-92fb-761801efa850 service nova] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:05:31.094715 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 515/1039] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:05:31 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 16:05:31.972357 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b7349-412a-4abc-a5fc-70bff7c92136 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:31.972935 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b7349-412a-4abc-a5fc-70bff7c92136 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:31.972935 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b7349-412a-4abc-a5fc-70bff7c92136 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:31.974314 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 525/1040] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 16:05:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:05:31.979971 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29692560-cf5a-4db1-9a57-ba732cb7ce9a None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:31.980395 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29692560-cf5a-4db1-9a57-ba732cb7ce9a None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:31.980487 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29692560-cf5a-4db1-9a57-ba732cb7ce9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:32.000275 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-29692560-cf5a-4db1-9a57-ba732cb7ce9a None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:05:32.001491 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-29692560-cf5a-4db1-9a57-ba732cb7ce9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:05:32.009572 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 516/1041] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 16:05:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:05:32.164621 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b7349-412a-4abc-a5fc-70bff7c92136 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:05:32.177992 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b7349-412a-4abc-a5fc-70bff7c92136 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:05:32.182909 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f62fe-f325-45fb-910a-574ff7e95bd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd90cec9e3ff64b5aa4cc867895b996ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:05:32.183494 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f62fe-f325-45fb-910a-574ff7e95bd1 service nova] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:32.183768 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f62fe-f325-45fb-910a-574ff7e95bd1 service nova] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:32.184037 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f62fe-f325-45fb-910a-574ff7e95bd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:32.192022 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699f62fe-f325-45fb-910a-574ff7e95bd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:05:32.194359 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699f62fe-f325-45fb-910a-574ff7e95bd1 service nova] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:05:32.203589 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 526/1042] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:05:32 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:05:33.085532 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6d4ea-58e6-4c7d-905c-c912b749e4b0 None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:33.086092 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6d4ea-58e6-4c7d-905c-c912b749e4b0 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:33.086187 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6d4ea-58e6-4c7d-905c-c912b749e4b0 None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:33.087492 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 517/1043] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 16:05:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:05:33.092286 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc0b5ba-932c-4ac6-8e2d-84cacf59872a None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:33.092749 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc0b5ba-932c-4ac6-8e2d-84cacf59872a None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:33.092850 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc0b5ba-932c-4ac6-8e2d-84cacf59872a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:33.111728 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-3fc0b5ba-932c-4ac6-8e2d-84cacf59872a None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:05:33.113227 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-3fc0b5ba-932c-4ac6-8e2d-84cacf59872a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:05:33.121153 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 527/1044] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 16:05:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:05:33.278176 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6d4ea-58e6-4c7d-905c-c912b749e4b0 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:05:33.291724 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6d4ea-58e6-4c7d-905c-c912b749e4b0 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:05:33.296657 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc7c53-dc64-42b4-89a6-ec360623a882 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd90cec9e3ff64b5aa4cc867895b996ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:05:33.297286 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc7c53-dc64-42b4-89a6-ec360623a882 service nova] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:33.297562 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc7c53-dc64-42b4-89a6-ec360623a882 service nova] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:33.297830 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc7c53-dc64-42b4-89a6-ec360623a882 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:33.305789 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc7c53-dc64-42b4-89a6-ec360623a882 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:05:33.307349 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc7c53-dc64-42b4-89a6-ec360623a882 service nova] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:05:33.316638 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 518/1045] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:05:33 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:05:34.166321 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c306782-c310-4bc5-95f7-4d84c92d71ad None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:34.166764 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c306782-c310-4bc5-95f7-4d84c92d71ad None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:34.166876 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c306782-c310-4bc5-95f7-4d84c92d71ad None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:34.168182 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 528/1046] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 16:05:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:05:34.173003 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0caa12-c4fa-49a9-a0c0-6c3eee65d52f None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:34.173398 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0caa12-c4fa-49a9-a0c0-6c3eee65d52f None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:34.173558 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0caa12-c4fa-49a9-a0c0-6c3eee65d52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:34.193642 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-be0caa12-c4fa-49a9-a0c0-6c3eee65d52f None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:05:34.194889 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-be0caa12-c4fa-49a9-a0c0-6c3eee65d52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:05:34.202826 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 519/1047] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 16:05:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:05:34.361344 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c306782-c310-4bc5-95f7-4d84c92d71ad None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:05:34.375276 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c306782-c310-4bc5-95f7-4d84c92d71ad None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:05:34.380341 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce5dbec-38ed-4315-8056-992f93d4e8fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd90cec9e3ff64b5aa4cc867895b996ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:05:34.381116 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5dbec-38ed-4315-8056-992f93d4e8fd service nova] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:34.381385 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5dbec-38ed-4315-8056-992f93d4e8fd service nova] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:34.381652 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5dbec-38ed-4315-8056-992f93d4e8fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:34.389662 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce5dbec-38ed-4315-8056-992f93d4e8fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:05:34.391250 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce5dbec-38ed-4315-8056-992f93d4e8fd service nova] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:05:34.401076 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 529/1048] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:05:34 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:05:35.270457 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677902d-0924-47d6-b0ad-71ab9752a84b None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:35.271035 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677902d-0924-47d6-b0ad-71ab9752a84b None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:35.271157 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677902d-0924-47d6-b0ad-71ab9752a84b None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:35.272508 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 520/1049] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 16:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:05:35.277411 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee4477-7b73-4988-9ce5-d636db463267 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:35.277858 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee4477-7b73-4988-9ce5-d636db463267 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:35.277956 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee4477-7b73-4988-9ce5-d636db463267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:35.297808 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-40ee4477-7b73-4988-9ce5-d636db463267 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:05:35.299002 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-40ee4477-7b73-4988-9ce5-d636db463267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:05:35.308177 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 530/1050] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 16:05:35 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:05:35.467485 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c677902d-0924-47d6-b0ad-71ab9752a84b None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:05:35.481538 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c677902d-0924-47d6-b0ad-71ab9752a84b None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:05:35.486385 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445bfc3f-3fc7-48b0-97f2-cea2240e7f5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd90cec9e3ff64b5aa4cc867895b996ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:05:35.486993 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445bfc3f-3fc7-48b0-97f2-cea2240e7f5c service nova] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:35.487519 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445bfc3f-3fc7-48b0-97f2-cea2240e7f5c service nova] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:35.487786 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445bfc3f-3fc7-48b0-97f2-cea2240e7f5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:35.496697 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445bfc3f-3fc7-48b0-97f2-cea2240e7f5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:05:35.498243 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445bfc3f-3fc7-48b0-97f2-cea2240e7f5c service nova] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:05:35.507787 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 521/1051] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:05:35 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:05:36.384917 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17959e36-97c7-4623-8293-0fe942b2b1ab None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:36.385393 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17959e36-97c7-4623-8293-0fe942b2b1ab None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:36.385537 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17959e36-97c7-4623-8293-0fe942b2b1ab None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:36.386861 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 531/1052] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 16:05:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:05:36.391820 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fe76d-8afc-44b1-91f3-ffbe44ddd107 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:36.392320 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fe76d-8afc-44b1-91f3-ffbe44ddd107 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:36.392419 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fe76d-8afc-44b1-91f3-ffbe44ddd107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:36.412435 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-fa7fe76d-8afc-44b1-91f3-ffbe44ddd107 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:05:36.413655 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-fa7fe76d-8afc-44b1-91f3-ffbe44ddd107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:05:36.421388 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 522/1053] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 16:05:36 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:05:36.576515 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17959e36-97c7-4623-8293-0fe942b2b1ab None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:05:36.590155 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17959e36-97c7-4623-8293-0fe942b2b1ab None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:05:36.594941 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f18b28-5a9e-4495-afd6-ad36cd730053 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd90cec9e3ff64b5aa4cc867895b996ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:05:36.595525 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f18b28-5a9e-4495-afd6-ad36cd730053 service nova] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:36.595796 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f18b28-5a9e-4495-afd6-ad36cd730053 service nova] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:36.596063 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f18b28-5a9e-4495-afd6-ad36cd730053 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:36.605221 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f18b28-5a9e-4495-afd6-ad36cd730053 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:05:36.606831 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f18b28-5a9e-4495-afd6-ad36cd730053 service nova] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:05:36.616229 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 532/1054] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:05:36 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:05:37.496369 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59060fb8-42dc-4e8e-b289-d6104a1f9f5d None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:37.496952 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59060fb8-42dc-4e8e-b289-d6104a1f9f5d None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:37.497061 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59060fb8-42dc-4e8e-b289-d6104a1f9f5d None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:37.498350 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 523/1055] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 16:05:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:05:37.503283 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f39bc4-b6d3-46a7-9d8b-9ebf624b9bb4 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:37.503712 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f39bc4-b6d3-46a7-9d8b-9ebf624b9bb4 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:37.503821 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f39bc4-b6d3-46a7-9d8b-9ebf624b9bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:37.523041 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-14f39bc4-b6d3-46a7-9d8b-9ebf624b9bb4 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:05:37.524217 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-14f39bc4-b6d3-46a7-9d8b-9ebf624b9bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:05:37.531896 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 533/1056] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 16:05:37 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:05:37.689055 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59060fb8-42dc-4e8e-b289-d6104a1f9f5d None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:05:37.702794 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59060fb8-42dc-4e8e-b289-d6104a1f9f5d None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:05:37.707766 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b8b545-5abe-4477-808c-2d833e1cbe6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd90cec9e3ff64b5aa4cc867895b996ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:05:37.708387 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8b545-5abe-4477-808c-2d833e1cbe6c service nova] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:37.708747 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8b545-5abe-4477-808c-2d833e1cbe6c service nova] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:37.709023 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8b545-5abe-4477-808c-2d833e1cbe6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:37.717219 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b8b545-5abe-4477-808c-2d833e1cbe6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:05:37.718794 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b8b545-5abe-4477-808c-2d833e1cbe6c service nova] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:05:37.728743 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 524/1057] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:05:37 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:05:39.800372 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69370cd3-6942-4d26-b84c-db76a189074a None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:39.800937 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69370cd3-6942-4d26-b84c-db76a189074a None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:39.800937 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69370cd3-6942-4d26-b84c-db76a189074a None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:39.802862 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 534/1058] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 16:05:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:05:39.808278 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c00f1-f2c2-488b-a152-ca4fb92e4cdc None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:39.808732 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c00f1-f2c2-488b-a152-ca4fb92e4cdc None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:39.808866 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c00f1-f2c2-488b-a152-ca4fb92e4cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:39.827647 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-525c00f1-f2c2-488b-a152-ca4fb92e4cdc None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:05:39.828864 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-525c00f1-f2c2-488b-a152-ca4fb92e4cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:05:39.836796 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 525/1059] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 16:05:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:05:40.181475 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69370cd3-6942-4d26-b84c-db76a189074a None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:05:40.192125 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69370cd3-6942-4d26-b84c-db76a189074a None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:05:40.195956 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e1bac1-a642-4519-b2d4-c7c9da2679c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5593ee9d30b4b65a215a4fe8dfba060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:05:40.196571 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1bac1-a642-4519-b2d4-c7c9da2679c8 service neutron] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:40.196880 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1bac1-a642-4519-b2d4-c7c9da2679c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:40.197152 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1bac1-a642-4519-b2d4-c7c9da2679c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:40.205922 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e1bac1-a642-4519-b2d4-c7c9da2679c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:05:40.207349 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e1bac1-a642-4519-b2d4-c7c9da2679c8 service neutron] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:05:40.217515 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 535/1060] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:05:40 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:05:42.557623 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7721c-0a48-4e98-b5ab-97cdad389539 None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:42.558227 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7721c-0a48-4e98-b5ab-97cdad389539 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:42.558227 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7721c-0a48-4e98-b5ab-97cdad389539 None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:42.559498 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 526/1061] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 16:05:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:05:42.564831 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f9e24-e486-4293-a4cb-2cb10dc8289d None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:42.565277 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f9e24-e486-4293-a4cb-2cb10dc8289d None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:42.565378 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f9e24-e486-4293-a4cb-2cb10dc8289d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:42.589988 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-db2f9e24-e486-4293-a4cb-2cb10dc8289d None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:05:42.591209 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-db2f9e24-e486-4293-a4cb-2cb10dc8289d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:05:42.598967 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 536/1062] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 16:05:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:05:42.958109 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f7721c-0a48-4e98-b5ab-97cdad389539 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:05:42.969741 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f7721c-0a48-4e98-b5ab-97cdad389539 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:05:42.973474 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f4e2f8-693d-4920-b0f6-bf6e45f8e066 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5593ee9d30b4b65a215a4fe8dfba060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:05:42.974565 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4e2f8-693d-4920-b0f6-bf6e45f8e066 service neutron] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:42.974827 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4e2f8-693d-4920-b0f6-bf6e45f8e066 service neutron] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:42.975102 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4e2f8-693d-4920-b0f6-bf6e45f8e066 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:42.984733 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f4e2f8-693d-4920-b0f6-bf6e45f8e066 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:05:42.986444 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f4e2f8-693d-4920-b0f6-bf6e45f8e066 service neutron] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:05:42.998537 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 527/1063] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:05:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:05:45.580457 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd2297-62bc-43b5-b54c-9eb6bffddd25 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:45.581044 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd2297-62bc-43b5-b54c-9eb6bffddd25 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:45.581044 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd2297-62bc-43b5-b54c-9eb6bffddd25 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:45.582377 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 537/1064] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 16:05:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:05:45.587830 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e61486-7542-4650-becc-1811b246abf8 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:45.588250 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e61486-7542-4650-becc-1811b246abf8 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:45.588378 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e61486-7542-4650-becc-1811b246abf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:45.607058 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-49e61486-7542-4650-becc-1811b246abf8 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:05:45.608281 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-49e61486-7542-4650-becc-1811b246abf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:05:45.616763 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 528/1065] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 16:05:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:05:45.966681 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd2297-62bc-43b5-b54c-9eb6bffddd25 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:05:45.977566 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd2297-62bc-43b5-b54c-9eb6bffddd25 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:05:45.980972 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1aa39c-592d-4a9a-817b-e4437ea32105 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5593ee9d30b4b65a215a4fe8dfba060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:05:45.981551 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1aa39c-592d-4a9a-817b-e4437ea32105 service neutron] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:45.981823 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1aa39c-592d-4a9a-817b-e4437ea32105 service neutron] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:45.982087 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1aa39c-592d-4a9a-817b-e4437ea32105 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:45.991121 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1aa39c-592d-4a9a-817b-e4437ea32105 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:05:45.992522 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1aa39c-592d-4a9a-817b-e4437ea32105 service neutron] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:05:46.001673 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 538/1066] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:05:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:05:48.382275 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c10d1-2df8-42b9-9c91-3d616422d4c8 None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:48.382778 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c10d1-2df8-42b9-9c91-3d616422d4c8 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:48.382885 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c10d1-2df8-42b9-9c91-3d616422d4c8 None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:48.384145 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 529/1067] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 16:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:05:48.389433 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004bada-ed24-4d15-95cd-e1feb34c4c00 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:48.389879 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004bada-ed24-4d15-95cd-e1feb34c4c00 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:48.389978 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004bada-ed24-4d15-95cd-e1feb34c4c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:48.408496 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-2004bada-ed24-4d15-95cd-e1feb34c4c00 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:05:48.409628 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-2004bada-ed24-4d15-95cd-e1feb34c4c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:05:48.417676 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 539/1068] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 16:05:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:05:48.758186 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4c10d1-2df8-42b9-9c91-3d616422d4c8 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:05:48.768726 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4c10d1-2df8-42b9-9c91-3d616422d4c8 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:05:48.772608 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8894721-aa98-44f8-b633-1a31b8d62f29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5593ee9d30b4b65a215a4fe8dfba060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:05:48.773226 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8894721-aa98-44f8-b633-1a31b8d62f29 service neutron] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:48.773498 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8894721-aa98-44f8-b633-1a31b8d62f29 service neutron] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:48.773762 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8894721-aa98-44f8-b633-1a31b8d62f29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:48.782342 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8894721-aa98-44f8-b633-1a31b8d62f29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:05:48.783741 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8894721-aa98-44f8-b633-1a31b8d62f29 service neutron] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:05:48.793828 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 530/1069] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:05:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:05:51.030042 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39e4ae-bd2f-4c45-a4fc-3c1f2f9afc08 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:51.030628 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39e4ae-bd2f-4c45-a4fc-3c1f2f9afc08 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:51.030628 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39e4ae-bd2f-4c45-a4fc-3c1f2f9afc08 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:51.031909 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 540/1070] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 16:05:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:05:51.037194 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f4c0b-75dc-4bbe-b11b-99bf1a665fdc None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:51.037616 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f4c0b-75dc-4bbe-b11b-99bf1a665fdc None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:51.037742 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f4c0b-75dc-4bbe-b11b-99bf1a665fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:51.056823 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-403f4c0b-75dc-4bbe-b11b-99bf1a665fdc None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:05:51.058004 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-403f4c0b-75dc-4bbe-b11b-99bf1a665fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:05:51.066183 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 531/1071] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 16:05:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:05:51.408626 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb39e4ae-bd2f-4c45-a4fc-3c1f2f9afc08 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:05:51.419530 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb39e4ae-bd2f-4c45-a4fc-3c1f2f9afc08 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:05:51.422990 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a37f75e-8fd9-4a93-9814-e7cf49eddfe3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5593ee9d30b4b65a215a4fe8dfba060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:05:51.423571 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37f75e-8fd9-4a93-9814-e7cf49eddfe3 service neutron] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:51.423842 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37f75e-8fd9-4a93-9814-e7cf49eddfe3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:51.424106 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37f75e-8fd9-4a93-9814-e7cf49eddfe3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:51.433530 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a37f75e-8fd9-4a93-9814-e7cf49eddfe3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:05:51.434934 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a37f75e-8fd9-4a93-9814-e7cf49eddfe3 service neutron] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:05:51.444942 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 541/1072] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:05:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:05:53.715187 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c79d8-5890-4b43-ab3b-c58f3876a117 None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:53.715756 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c79d8-5890-4b43-ab3b-c58f3876a117 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:53.715756 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c79d8-5890-4b43-ab3b-c58f3876a117 None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:53.717161 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 532/1073] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 16:05:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:05:53.722322 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6da93-d764-483f-8e45-89d2ed51086c None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:53.722700 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6da93-d764-483f-8e45-89d2ed51086c None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:53.722898 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6da93-d764-483f-8e45-89d2ed51086c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:53.742456 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-bfb6da93-d764-483f-8e45-89d2ed51086c None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:05:53.743629 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-bfb6da93-d764-483f-8e45-89d2ed51086c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:05:53.751399 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 542/1074] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 16:05:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:05:54.092946 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c79d8-5890-4b43-ab3b-c58f3876a117 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:05:54.103863 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c79d8-5890-4b43-ab3b-c58f3876a117 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:05:54.107317 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576a700e-de6e-401d-9c4f-bfe1ca8dd0d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5593ee9d30b4b65a215a4fe8dfba060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:05:54.107898 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a700e-de6e-401d-9c4f-bfe1ca8dd0d5 service neutron] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:54.108171 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a700e-de6e-401d-9c4f-bfe1ca8dd0d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:54.108436 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a700e-de6e-401d-9c4f-bfe1ca8dd0d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:54.117400 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576a700e-de6e-401d-9c4f-bfe1ca8dd0d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:05:54.118799 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576a700e-de6e-401d-9c4f-bfe1ca8dd0d5 service neutron] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:05:54.128001 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 533/1075] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:05:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:05:56.369721 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add2925-1b5a-4421-8c5f-4e365b03637a None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:56.370219 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add2925-1b5a-4421-8c5f-4e365b03637a None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:56.370327 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add2925-1b5a-4421-8c5f-4e365b03637a None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:56.371562 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 543/1076] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 16:05:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:05:56.376754 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ce0ef-3c5e-4dc1-939b-b7b995b147fd None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:56.377247 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ce0ef-3c5e-4dc1-939b-b7b995b147fd None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:56.377376 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ce0ef-3c5e-4dc1-939b-b7b995b147fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:56.385124 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=70 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:05:56.397828 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-212ce0ef-3c5e-4dc1-939b-b7b995b147fd None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:05:56.399023 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-212ce0ef-3c5e-4dc1-939b-b7b995b147fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:05:56.407099 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 534/1077] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 16:05:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:05:56.753195 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3add2925-1b5a-4421-8c5f-4e365b03637a None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:05:56.758596 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=73 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:05:56.764400 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3add2925-1b5a-4421-8c5f-4e365b03637a None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:05:56.767970 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a909d544-91a2-48d7-8e85-a53dfa8a54f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5593ee9d30b4b65a215a4fe8dfba060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:05:56.771194 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909d544-91a2-48d7-8e85-a53dfa8a54f1 service neutron] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:56.771194 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909d544-91a2-48d7-8e85-a53dfa8a54f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:56.771194 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909d544-91a2-48d7-8e85-a53dfa8a54f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:56.778661 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a909d544-91a2-48d7-8e85-a53dfa8a54f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:05:56.780066 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a909d544-91a2-48d7-8e85-a53dfa8a54f1 service neutron] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:05:56.790554 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 544/1078] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:05:56 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:05:59.030780 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0632da-dc36-482a-a7bf-fa4eef81bbda None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:59.031323 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0632da-dc36-482a-a7bf-fa4eef81bbda None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:59.031323 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0632da-dc36-482a-a7bf-fa4eef81bbda None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:59.032679 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 535/1079] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 16:05:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:05:59.038675 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638b891-0476-4038-95ff-6692a8e5f911 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:59.039087 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638b891-0476-4038-95ff-6692a8e5f911 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:59.039196 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638b891-0476-4038-95ff-6692a8e5f911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:59.058018 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-c638b891-0476-4038-95ff-6692a8e5f911 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:05:59.059198 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-c638b891-0476-4038-95ff-6692a8e5f911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:05:59.066868 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 545/1080] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 16:05:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:05:59.420851 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0632da-dc36-482a-a7bf-fa4eef81bbda None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:05:59.434513 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0632da-dc36-482a-a7bf-fa4eef81bbda None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:05:59.438131 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802b56c-a0c1-4f11-b70f-9e29e7721ceb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5593ee9d30b4b65a215a4fe8dfba060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:05:59.438726 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802b56c-a0c1-4f11-b70f-9e29e7721ceb service neutron] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:05:59.439002 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802b56c-a0c1-4f11-b70f-9e29e7721ceb service neutron] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:05:59.439272 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802b56c-a0c1-4f11-b70f-9e29e7721ceb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:05:59.449517 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9802b56c-a0c1-4f11-b70f-9e29e7721ceb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:05:59.451725 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9802b56c-a0c1-4f11-b70f-9e29e7721ceb service neutron] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:05:59.461135 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 536/1081] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:05:59 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:06:01.651934 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a2138-3d1d-4685-93a5-1bda2ac00a08 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:06:01.652439 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a2138-3d1d-4685-93a5-1bda2ac00a08 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:06:01.652439 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a2138-3d1d-4685-93a5-1bda2ac00a08 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:06:01.653779 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 546/1082] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 16:06:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:06:01.658965 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5d66f-df45-4fc8-818c-07cd4c9a35eb None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:06:01.659468 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5d66f-df45-4fc8-818c-07cd4c9a35eb None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:06:01.659719 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5d66f-df45-4fc8-818c-07cd4c9a35eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:06:01.679854 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-40b5d66f-df45-4fc8-818c-07cd4c9a35eb None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:06:01.681111 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-40b5d66f-df45-4fc8-818c-07cd4c9a35eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:06:01.688816 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 537/1083] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 16:06:01 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:06:02.031086 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a2138-3d1d-4685-93a5-1bda2ac00a08 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:06:02.042333 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a2138-3d1d-4685-93a5-1bda2ac00a08 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:06:02.045838 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321e3103-5fb7-41ef-acbe-54034e77264e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5593ee9d30b4b65a215a4fe8dfba060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:06:02.046418 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e3103-5fb7-41ef-acbe-54034e77264e service neutron] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:06:02.046689 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e3103-5fb7-41ef-acbe-54034e77264e service neutron] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:06:02.046954 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e3103-5fb7-41ef-acbe-54034e77264e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:06:02.055750 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321e3103-5fb7-41ef-acbe-54034e77264e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:06:02.057215 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321e3103-5fb7-41ef-acbe-54034e77264e service neutron] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:06:02.066335 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 547/1084] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:06:02 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:06:04.260797 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ee485-9482-4e28-b232-acddd041792d None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:06:04.261345 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ee485-9482-4e28-b232-acddd041792d None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:06:04.261345 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ee485-9482-4e28-b232-acddd041792d None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:06:04.262668 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 538/1085] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 16:06:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:06:04.268065 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76657b0f-4854-4630-b993-8a16b20551fb None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:06:04.268475 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76657b0f-4854-4630-b993-8a16b20551fb None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:06:04.268569 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76657b0f-4854-4630-b993-8a16b20551fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:06:04.288153 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-76657b0f-4854-4630-b993-8a16b20551fb None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:06:04.289383 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-76657b0f-4854-4630-b993-8a16b20551fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:06:04.297036 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 548/1086] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 16:06:04 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:06:04.640160 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ee485-9482-4e28-b232-acddd041792d None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:06:04.650968 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ee485-9482-4e28-b232-acddd041792d None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:06:04.654519 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e146d2-c0d0-4611-b80b-4d1cec91ff4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5593ee9d30b4b65a215a4fe8dfba060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:06:04.655109 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e146d2-c0d0-4611-b80b-4d1cec91ff4c service neutron] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:06:04.655386 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e146d2-c0d0-4611-b80b-4d1cec91ff4c service neutron] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:06:04.655655 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e146d2-c0d0-4611-b80b-4d1cec91ff4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:06:04.665573 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e146d2-c0d0-4611-b80b-4d1cec91ff4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:06:04.666996 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e146d2-c0d0-4611-b80b-4d1cec91ff4c service neutron] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:06:04.677133 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 539/1087] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:06:04 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:06:14.283355 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=17 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:06:14.672270 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=17 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:06:28.865912 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f5060-c9bd-4133-9ff3-d69832f224e0 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:06:28.866475 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f5060-c9bd-4133-9ff3-d69832f224e0 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:06:28.866475 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f5060-c9bd-4133-9ff3-d69832f224e0 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:06:28.867768 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 549/1088] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 16:06:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:06:28.872853 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032b656-06c2-419a-8d54-c5d1710fca09 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:06:28.873284 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032b656-06c2-419a-8d54-c5d1710fca09 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:06:28.873383 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032b656-06c2-419a-8d54-c5d1710fca09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:06:28.892407 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-d032b656-06c2-419a-8d54-c5d1710fca09 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:06:28.893661 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-d032b656-06c2-419a-8d54-c5d1710fca09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:06:28.901333 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 540/1089] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 16:06:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:06:29.255189 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ee970-5a6d-4815-8e7f-86177084c827 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:06:29.255509 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ee970-5a6d-4815-8e7f-86177084c827 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:06:29.255786 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ee970-5a6d-4815-8e7f-86177084c827 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:06:29.257155 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 550/1090] 10.222.0.70 () {54 vars in 967 bytes} [Fri Aug 19 16:06:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:06:29.262285 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4282b6f-7932-49f8-a04e-7edf6f549d54 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:06:29.262565 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4282b6f-7932-49f8-a04e-7edf6f549d54 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:06:29.262839 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4282b6f-7932-49f8-a04e-7edf6f549d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:06:29.282413 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-b4282b6f-7932-49f8-a04e-7edf6f549d54 None None] MFA Rules not processed for user `3d70aff7f0a448bb9a5cc2b78c828590`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:06:29.283588 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-b4282b6f-7932-49f8-a04e-7edf6f549d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:06:29.291008 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 541/1091] 10.222.0.70 () {58 vars in 1064 bytes} [Fri Aug 19 16:06:29 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:06:29.298269 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ee970-5a6d-4815-8e7f-86177084c827 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:06:29.309776 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ee970-5a6d-4815-8e7f-86177084c827 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:06:29.313222 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84facfa-f831-4246-968c-f0ebf76318ba service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d70aff7f0a448bb9a5cc2b78c828590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:06:29.313806 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84facfa-f831-4246-968c-f0ebf76318ba service glance] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:06:29.314110 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84facfa-f831-4246-968c-f0ebf76318ba service glance] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:06:29.314378 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84facfa-f831-4246-968c-f0ebf76318ba service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:06:29.323262 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84facfa-f831-4246-968c-f0ebf76318ba service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:06:29.324704 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84facfa-f831-4246-968c-f0ebf76318ba service glance] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:06:29.333961 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 551/1092] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:06:29 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:06:31.620322 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622637d2-6862-4e9a-9bcd-0f208527ece3 None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:06:31.620890 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622637d2-6862-4e9a-9bcd-0f208527ece3 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:06:31.620890 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622637d2-6862-4e9a-9bcd-0f208527ece3 None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:06:31.622137 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 542/1093] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 16:06:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:06:31.627328 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5155b4-62be-4ce1-b8d5-5ec7472b82b7 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:06:31.627761 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5155b4-62be-4ce1-b8d5-5ec7472b82b7 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:06:31.627924 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5155b4-62be-4ce1-b8d5-5ec7472b82b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:06:31.646684 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-df5155b4-62be-4ce1-b8d5-5ec7472b82b7 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:06:31.647853 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-df5155b4-62be-4ce1-b8d5-5ec7472b82b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:06:31.655479 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 552/1094] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 16:06:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:06:31.994590 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622637d2-6862-4e9a-9bcd-0f208527ece3 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:06:32.007104 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622637d2-6862-4e9a-9bcd-0f208527ece3 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:06:32.011484 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f0768-146d-40d3-8126-5b074cf63b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e72646e5274546c7b7216d7348ce3bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:06:32.012140 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f0768-146d-40d3-8126-5b074cf63b95 admin admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:06:32.012423 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f0768-146d-40d3-8126-5b074cf63b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:06:32.012730 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f0768-146d-40d3-8126-5b074cf63b95 admin admin] PATH_INFO: `/v3/projects` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:06:32.013360 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107f0768-146d-40d3-8126-5b074cf63b95 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:06:32.015120 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: WARNING py.warnings [None req-107f0768-146d-40d3-8126-5b074cf63b95 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 16:06:32.015120 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: warnings.warn(msg) Aug 19 16:06:32.015120 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: Aug 19 16:06:32.016260 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107f0768-146d-40d3-8126-5b074cf63b95 admin admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:06:32.035354 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 543/1095] 10.222.0.70 () {56 vars in 1108 bytes} [Fri Aug 19 16:06:31 2022] GET /identity/v3/projects => generated 1606 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:06:34.241649 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a4025-4fab-4e71-bfbb-85aaff8ef067 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:06:34.242208 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a4025-4fab-4e71-bfbb-85aaff8ef067 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:06:34.242208 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a4025-4fab-4e71-bfbb-85aaff8ef067 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:06:34.244755 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 553/1096] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 16:06:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:06:34.249033 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30da0b-5eec-41b7-acee-4b5dd95cff0e None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:06:34.249474 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30da0b-5eec-41b7-acee-4b5dd95cff0e None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:06:34.249570 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30da0b-5eec-41b7-acee-4b5dd95cff0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:06:34.269968 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-1b30da0b-5eec-41b7-acee-4b5dd95cff0e None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:06:34.275283 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-1b30da0b-5eec-41b7-acee-4b5dd95cff0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:06:34.279010 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 544/1097] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 16:06:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:06:34.631697 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a4025-4fab-4e71-bfbb-85aaff8ef067 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:06:34.645659 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a4025-4fab-4e71-bfbb-85aaff8ef067 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:06:34.650449 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adbf12d-0247-433f-9548-9036003b7036 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd90cec9e3ff64b5aa4cc867895b996ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:06:34.651030 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adbf12d-0247-433f-9548-9036003b7036 service nova] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:06:34.651303 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adbf12d-0247-433f-9548-9036003b7036 service nova] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:06:34.651568 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adbf12d-0247-433f-9548-9036003b7036 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:06:34.659794 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adbf12d-0247-433f-9548-9036003b7036 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:06:34.661493 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adbf12d-0247-433f-9548-9036003b7036 service nova] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:06:34.670700 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 554/1098] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:06:34 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:06:37.053879 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e40220-5186-42a4-8f73-00bcf80ea029 None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:06:37.054449 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e40220-5186-42a4-8f73-00bcf80ea029 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:06:37.054449 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e40220-5186-42a4-8f73-00bcf80ea029 None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:06:37.055784 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 545/1099] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 16:06:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 16:06:37.061013 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9359add-a132-4e30-92e8-b15ef7613cef None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:06:37.061408 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9359add-a132-4e30-92e8-b15ef7613cef None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:06:37.061553 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9359add-a132-4e30-92e8-b15ef7613cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:06:37.080945 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-f9359add-a132-4e30-92e8-b15ef7613cef None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:06:37.082228 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-f9359add-a132-4e30-92e8-b15ef7613cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:06:37.090080 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 555/1100] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 16:06:37 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:06:37.433505 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e40220-5186-42a4-8f73-00bcf80ea029 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:06:37.444908 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e40220-5186-42a4-8f73-00bcf80ea029 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:06:37.448424 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5290a0a-fadf-4143-b606-4929184c08f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5593ee9d30b4b65a215a4fe8dfba060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:06:37.449046 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5290a0a-fadf-4143-b606-4929184c08f2 service neutron] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:06:37.449323 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5290a0a-fadf-4143-b606-4929184c08f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:06:37.449593 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5290a0a-fadf-4143-b606-4929184c08f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:06:37.458826 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5290a0a-fadf-4143-b606-4929184c08f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:06:37.460252 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5290a0a-fadf-4143-b606-4929184c08f2 service neutron] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:06:37.469456 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 546/1101] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:06:37 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:06:39.704656 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf1cb8d-ab7a-45c4-b97a-4874df74a7ce None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:06:39.705808 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf1cb8d-ab7a-45c4-b97a-4874df74a7ce None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:06:39.705808 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf1cb8d-ab7a-45c4-b97a-4874df74a7ce None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:06:39.707069 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 556/1102] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 16:06:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:06:39.712363 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc96cc-7f9c-47e2-9d6c-4bbf87a3ecae None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:06:39.712793 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc96cc-7f9c-47e2-9d6c-4bbf87a3ecae None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:06:39.713288 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc96cc-7f9c-47e2-9d6c-4bbf87a3ecae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:06:39.732615 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-94bc96cc-7f9c-47e2-9d6c-4bbf87a3ecae None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:06:39.733868 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-94bc96cc-7f9c-47e2-9d6c-4bbf87a3ecae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:06:39.742110 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 547/1103] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 16:06:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:06:40.098430 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf1cb8d-ab7a-45c4-b97a-4874df74a7ce None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:06:40.109233 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf1cb8d-ab7a-45c4-b97a-4874df74a7ce None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:06:40.113697 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248af5cd-bf84-4e44-959a-393bf4eb813b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5593ee9d30b4b65a215a4fe8dfba060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:06:40.114286 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248af5cd-bf84-4e44-959a-393bf4eb813b service neutron] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:06:40.114565 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248af5cd-bf84-4e44-959a-393bf4eb813b service neutron] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:06:40.114837 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248af5cd-bf84-4e44-959a-393bf4eb813b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:06:40.123706 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248af5cd-bf84-4e44-959a-393bf4eb813b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:06:40.125166 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248af5cd-bf84-4e44-959a-393bf4eb813b service neutron] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:06:40.135294 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 557/1104] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:06:40 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:06:42.407253 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3ebd5-cab2-4d5f-99a4-1b196b97793b None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:06:42.407783 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3ebd5-cab2-4d5f-99a4-1b196b97793b None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:06:42.407783 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3ebd5-cab2-4d5f-99a4-1b196b97793b None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:06:42.410104 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 548/1105] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 16:06:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:06:42.415328 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0fc196-435d-4916-a623-21e369389965 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:06:42.415761 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0fc196-435d-4916-a623-21e369389965 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:06:42.415871 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0fc196-435d-4916-a623-21e369389965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:06:42.434656 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-fb0fc196-435d-4916-a623-21e369389965 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:06:42.435878 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-fb0fc196-435d-4916-a623-21e369389965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:06:42.443793 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 558/1106] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 16:06:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:06:42.797378 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3ebd5-cab2-4d5f-99a4-1b196b97793b None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:06:42.808055 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3ebd5-cab2-4d5f-99a4-1b196b97793b None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:06:42.811527 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a36f28f-78f4-4f90-bc8b-70f8ee1867c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5593ee9d30b4b65a215a4fe8dfba060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:06:42.815025 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36f28f-78f4-4f90-bc8b-70f8ee1867c9 service neutron] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:06:42.815025 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36f28f-78f4-4f90-bc8b-70f8ee1867c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:06:42.815025 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36f28f-78f4-4f90-bc8b-70f8ee1867c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:06:42.822118 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a36f28f-78f4-4f90-bc8b-70f8ee1867c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:06:42.823714 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a36f28f-78f4-4f90-bc8b-70f8ee1867c9 service neutron] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:06:42.833670 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 549/1107] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:06:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:06:45.504038 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011ce28-798a-4429-9930-8c01f7150240 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:06:45.504693 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011ce28-798a-4429-9930-8c01f7150240 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:06:45.504809 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011ce28-798a-4429-9930-8c01f7150240 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:06:45.506083 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 559/1108] 10.222.0.70 () {54 vars in 927 bytes} [Fri Aug 19 16:06:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:06:45.511377 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a42ead-cd3a-402a-91e9-39eca7863747 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:06:45.511882 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a42ead-cd3a-402a-91e9-39eca7863747 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:06:45.511993 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a42ead-cd3a-402a-91e9-39eca7863747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:06:45.531301 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-55a42ead-cd3a-402a-91e9-39eca7863747 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:06:45.532486 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-55a42ead-cd3a-402a-91e9-39eca7863747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:06:45.540992 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 550/1109] 10.222.0.70 () {58 vars in 1024 bytes} [Fri Aug 19 16:06:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:06:45.888536 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7011ce28-798a-4429-9930-8c01f7150240 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:06:45.899871 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7011ce28-798a-4429-9930-8c01f7150240 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:06:45.903371 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da4afa-d040-4619-a0ec-23e8011a2366 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5593ee9d30b4b65a215a4fe8dfba060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:06:45.903956 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da4afa-d040-4619-a0ec-23e8011a2366 service neutron] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:06:45.904233 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da4afa-d040-4619-a0ec-23e8011a2366 service neutron] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:06:45.904504 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da4afa-d040-4619-a0ec-23e8011a2366 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:06:45.913341 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da4afa-d040-4619-a0ec-23e8011a2366 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:06:45.914763 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da4afa-d040-4619-a0ec-23e8011a2366 service neutron] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:06:45.924028 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 560/1110] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:06:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:06:55.526635 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=33 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:06:55.919888 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=33 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:08:09.692337 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697c024-a19c-4aa8-9a4e-4783e6575a09 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:08:09.692944 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697c024-a19c-4aa8-9a4e-4783e6575a09 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:08:09.692944 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697c024-a19c-4aa8-9a4e-4783e6575a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:08:09.711973 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-8697c024-a19c-4aa8-9a4e-4783e6575a09 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:08:09.713236 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-8697c024-a19c-4aa8-9a4e-4783e6575a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:08:09.722082 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 551/1111] 10.222.0.70 () {58 vars in 958 bytes} [Fri Aug 19 16:08:09 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:08:09.730027 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b437090-d228-4f02-9922-64bd57f31bb0 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:08:09.730577 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b437090-d228-4f02-9922-64bd57f31bb0 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:08:09.730577 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b437090-d228-4f02-9922-64bd57f31bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:08:09.750828 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-6b437090-d228-4f02-9922-64bd57f31bb0 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:08:09.752009 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-6b437090-d228-4f02-9922-64bd57f31bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:08:09.759671 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 561/1112] 10.222.0.70 () {58 vars in 958 bytes} [Fri Aug 19 16:08:09 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:08:09.764377 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8697c024-a19c-4aa8-9a4e-4783e6575a09 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:08:09.773933 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8697c024-a19c-4aa8-9a4e-4783e6575a09 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:08:09.778500 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dcb1e4-f19b-405b-b750-37f2e53a6f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e72646e5274546c7b7216d7348ce3bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:08:09.779631 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dcb1e4-f19b-405b-b750-37f2e53a6f8d admin admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:08:09.779909 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dcb1e4-f19b-405b-b750-37f2e53a6f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:08:09.780173 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dcb1e4-f19b-405b-b750-37f2e53a6f8d admin admin] PATH_INFO: `/v3/domains` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:08:09.780840 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dcb1e4-f19b-405b-b750-37f2e53a6f8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:08:09.781138 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dcb1e4-f19b-405b-b750-37f2e53a6f8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:08:09.782175 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: WARNING py.warnings [None req-84dcb1e4-f19b-405b-b750-37f2e53a6f8d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 16:08:09.782175 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: warnings.warn(msg) Aug 19 16:08:09.782175 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: Aug 19 16:08:09.783057 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dcb1e4-f19b-405b-b750-37f2e53a6f8d admin admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:08:09.795139 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 552/1113] 10.222.0.70 () {58 vars in 1153 bytes} [Fri Aug 19 16:08:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:08:09.803523 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b437090-d228-4f02-9922-64bd57f31bb0 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:08:09.813041 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b437090-d228-4f02-9922-64bd57f31bb0 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:08:09.817597 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333fde73-9d33-46b6-9d74-f80ccec47273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e72646e5274546c7b7216d7348ce3bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:08:09.818179 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333fde73-9d33-46b6-9d74-f80ccec47273 admin admin] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:08:09.818449 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333fde73-9d33-46b6-9d74-f80ccec47273 admin admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:08:09.818717 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333fde73-9d33-46b6-9d74-f80ccec47273 admin admin] PATH_INFO: `/v3/projects` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:08:09.819319 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333fde73-9d33-46b6-9d74-f80ccec47273 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:08:09.821080 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: WARNING py.warnings [None req-333fde73-9d33-46b6-9d74-f80ccec47273 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 16:08:09.821080 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: warnings.warn(msg) Aug 19 16:08:09.821080 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: Aug 19 16:08:09.822261 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333fde73-9d33-46b6-9d74-f80ccec47273 admin admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:08:09.913738 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 562/1114] 10.222.0.70 () {60 vars in 1153 bytes} [Fri Aug 19 16:08:09 2022] POST /identity/v3/projects => generated 377 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:08:09.917915 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dcb1e4-f19b-405b-b750-37f2e53a6f8d admin admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:08:09.929208 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dcb1e4-f19b-405b-b750-37f2e53a6f8d admin admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:08:09.985327 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14384ed-dae3-40b6-807a-52390c742307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e72646e5274546c7b7216d7348ce3bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:08:09.985921 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14384ed-dae3-40b6-807a-52390c742307 admin admin] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:08:09.986195 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14384ed-dae3-40b6-807a-52390c742307 admin admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:08:09.986463 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14384ed-dae3-40b6-807a-52390c742307 admin admin] PATH_INFO: `/v3/users` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:08:09.987082 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14384ed-dae3-40b6-807a-52390c742307 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:08:09.988067 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: WARNING py.warnings [None req-a14384ed-dae3-40b6-807a-52390c742307 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 16:08:09.988067 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: warnings.warn(msg) Aug 19 16:08:09.988067 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: Aug 19 16:08:09.989341 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14384ed-dae3-40b6-807a-52390c742307 admin admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:08:10.090543 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 553/1115] 10.222.0.70 () {60 vars in 1144 bytes} [Fri Aug 19 16:08:09 2022] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:08:10.095635 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333fde73-9d33-46b6-9d74-f80ccec47273 admin admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:08:10.106276 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333fde73-9d33-46b6-9d74-f80ccec47273 admin admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:08:10.111772 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40b7eb3-03d8-4d8d-a855-647a6b74ffb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e72646e5274546c7b7216d7348ce3bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:08:10.112356 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b7eb3-03d8-4d8d-a855-647a6b74ffb2 admin admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:08:10.112628 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b7eb3-03d8-4d8d-a855-647a6b74ffb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:08:10.112921 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b7eb3-03d8-4d8d-a855-647a6b74ffb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:08:10.113537 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40b7eb3-03d8-4d8d-a855-647a6b74ffb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:08:10.114526 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: WARNING py.warnings [None req-d40b7eb3-03d8-4d8d-a855-647a6b74ffb2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 16:08:10.114526 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: warnings.warn(msg) Aug 19 16:08:10.114526 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: Aug 19 16:08:10.115399 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40b7eb3-03d8-4d8d-a855-647a6b74ffb2 admin admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:08:10.129095 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 563/1116] 10.222.0.70 () {58 vars in 1122 bytes} [Fri Aug 19 16:08:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:08:10.133101 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14384ed-dae3-40b6-807a-52390c742307 admin admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:08:10.143752 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14384ed-dae3-40b6-807a-52390c742307 admin admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:08:10.148367 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e145e2-d5b8-4111-9e9c-0c770f25d901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e72646e5274546c7b7216d7348ce3bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:08:10.148991 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e145e2-d5b8-4111-9e9c-0c770f25d901 admin admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:08:10.149260 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e145e2-d5b8-4111-9e9c-0c770f25d901 admin admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:08:10.149526 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e145e2-d5b8-4111-9e9c-0c770f25d901 admin admin] PATH_INFO: `/v3/roles` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:08:10.150150 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e145e2-d5b8-4111-9e9c-0c770f25d901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:08:10.151130 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: WARNING py.warnings [None req-62e145e2-d5b8-4111-9e9c-0c770f25d901 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 16:08:10.151130 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: warnings.warn(msg) Aug 19 16:08:10.151130 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: Aug 19 16:08:10.152004 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e145e2-d5b8-4111-9e9c-0c770f25d901 admin admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:08:10.165784 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 554/1117] 10.222.0.70 () {58 vars in 1122 bytes} [Fri Aug 19 16:08:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:08:10.170028 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40b7eb3-03d8-4d8d-a855-647a6b74ffb2 admin admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:08:10.179958 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40b7eb3-03d8-4d8d-a855-647a6b74ffb2 admin admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:08:10.184457 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5642e316-87b3-4976-8706-ac75c64476ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e72646e5274546c7b7216d7348ce3bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:08:10.185214 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642e316-87b3-4976-8706-ac75c64476ff admin admin] REQUEST_METHOD: `PUT` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:08:10.185494 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642e316-87b3-4976-8706-ac75c64476ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:08:10.185773 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642e316-87b3-4976-8706-ac75c64476ff admin admin] PATH_INFO: `/v3/projects/41042c35e52046abb8f593bfb0bd3cff/users/1ff2652abeed429b89e2c49d48c69482/roles/09971bc698e84205be000073fc048af2` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:08:10.200167 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5642e316-87b3-4976-8706-ac75c64476ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=41042c35e52046abb8f593bfb0bd3cff, user_id=1ff2652abeed429b89e2c49d48c69482, role_id=09971bc698e84205be000073fc048af2)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:08:10.201743 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: WARNING py.warnings [None req-5642e316-87b3-4976-8706-ac75c64476ff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 16:08:10.201743 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: warnings.warn(msg) Aug 19 16:08:10.201743 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: Aug 19 16:08:10.203670 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5642e316-87b3-4976-8706-ac75c64476ff admin admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:08:10.302779 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 564/1118] 10.222.0.70 () {60 vars in 1483 bytes} [Fri Aug 19 16:08:10 2022] PUT /identity/v3/projects/41042c35e52046abb8f593bfb0bd3cff/users/1ff2652abeed429b89e2c49d48c69482/roles/09971bc698e84205be000073fc048af2 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:08:10.315844 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e64645-b08b-4d69-a111-921d5c87e3f6 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:08:10.316126 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e64645-b08b-4d69-a111-921d5c87e3f6 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:08:10.316398 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e64645-b08b-4d69-a111-921d5c87e3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:08:10.346693 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-94e64645-b08b-4d69-a111-921d5c87e3f6 None None] MFA Rules not processed for user `1ff2652abeed429b89e2c49d48c69482`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:08:10.351367 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-94e64645-b08b-4d69-a111-921d5c87e3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:08:10.417578 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 555/1119] 10.222.0.70 () {58 vars in 958 bytes} [Fri Aug 19 16:08:10 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:08:10.431351 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6dc8e-1f26-4b19-883d-54fdf30f542e None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:08:10.436541 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6dc8e-1f26-4b19-883d-54fdf30f542e None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:08:10.436541 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6dc8e-1f26-4b19-883d-54fdf30f542e None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:08:10.436541 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 565/1120] 10.222.0.70 () {54 vars in 964 bytes} [Fri Aug 19 16:08:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:08:10.438748 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e365c-83a3-4a48-80c5-7ee884d64125 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:08:10.439030 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e365c-83a3-4a48-80c5-7ee884d64125 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:08:10.439305 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e365c-83a3-4a48-80c5-7ee884d64125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:08:10.460216 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-669e365c-83a3-4a48-80c5-7ee884d64125 None None] MFA Rules not processed for user `92eb2988fd86400dacb28eeef921a4b8`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:08:10.461634 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-669e365c-83a3-4a48-80c5-7ee884d64125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:08:10.506582 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:08:10.514830 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 556/1121] 10.222.0.70 () {58 vars in 1061 bytes} [Fri Aug 19 16:08:10 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:08:10.522441 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c6dc8e-1f26-4b19-883d-54fdf30f542e None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:08:10.533204 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c6dc8e-1f26-4b19-883d-54fdf30f542e None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:08:10.536789 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf5dbd1-fd80-472a-8297-f84d1888a14a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92eb2988fd86400dacb28eeef921a4b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:08:10.537363 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5dbd1-fd80-472a-8297-f84d1888a14a service cinder] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:08:10.537641 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5dbd1-fd80-472a-8297-f84d1888a14a service cinder] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:08:10.537989 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5dbd1-fd80-472a-8297-f84d1888a14a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:08:10.546838 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf5dbd1-fd80-472a-8297-f84d1888a14a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:08:10.548344 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf5dbd1-fd80-472a-8297-f84d1888a14a service cinder] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:08:10.556975 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 566/1122] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:08:10 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:08:10.598383 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8bbb1-2d9f-4051-bd56-bfe41d5ddd2a None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:08:10.598670 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8bbb1-2d9f-4051-bd56-bfe41d5ddd2a None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:08:10.598946 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8bbb1-2d9f-4051-bd56-bfe41d5ddd2a None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:08:10.600224 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 557/1123] 10.222.0.70 () {52 vars in 830 bytes} [Fri Aug 19 16:08:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:08:10.603935 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf5dbd1-fd80-472a-8297-f84d1888a14a service cinder] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:08:10.672886 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf5dbd1-fd80-472a-8297-f84d1888a14a service cinder] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:08:10.679161 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b6256-576e-46a0-ad37-fed2052d622d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e72646e5274546c7b7216d7348ce3bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:08:10.679161 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b6256-576e-46a0-ad37-fed2052d622d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:08:10.679161 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b6256-576e-46a0-ad37-fed2052d622d admin admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:08:10.679161 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b6256-576e-46a0-ad37-fed2052d622d admin admin] PATH_INFO: `/v3/users/1ff2652abeed429b89e2c49d48c69482` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:08:10.680346 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b6256-576e-46a0-ad37-fed2052d622d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ff2652abeed429b89e2c49d48c69482)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:08:10.681945 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: WARNING py.warnings [None req-d32b6256-576e-46a0-ad37-fed2052d622d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 16:08:10.681945 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: warnings.warn(msg) Aug 19 16:08:10.681945 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: Aug 19 16:08:10.683334 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b6256-576e-46a0-ad37-fed2052d622d admin admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:08:11.260355 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.notifications [None req-d32b6256-576e-46a0-ad37-fed2052d622d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ff2652abeed429b89e2c49d48c69482'} {{(pid=88368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:08:11.274597 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.notifications [None req-d32b6256-576e-46a0-ad37-fed2052d622d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ff2652abeed429b89e2c49d48c69482'} {{(pid=88368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:08:11.299100 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.notifications [None req-d32b6256-576e-46a0-ad37-fed2052d622d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ff2652abeed429b89e2c49d48c69482'} {{(pid=88368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:08:11.303047 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:08:11.387828 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.notifications [None req-d32b6256-576e-46a0-ad37-fed2052d622d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ff2652abeed429b89e2c49d48c69482'} {{(pid=88368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:08:11.388891 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.notifications [None req-d32b6256-576e-46a0-ad37-fed2052d622d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ff2652abeed429b89e2c49d48c69482'} {{(pid=88368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:08:11.395246 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 567/1124] 10.222.0.70 () {58 vars in 1224 bytes} [Fri Aug 19 16:08:10 2022] DELETE /identity/v3/users/1ff2652abeed429b89e2c49d48c69482 => generated 0 bytes in 792 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:08:11.399809 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc92ffe-c70b-423e-ac63-72a0d784e5b0 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:08:11.400274 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc92ffe-c70b-423e-ac63-72a0d784e5b0 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:08:11.400274 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc92ffe-c70b-423e-ac63-72a0d784e5b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:08:11.420387 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-6cc92ffe-c70b-423e-ac63-72a0d784e5b0 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:08:11.421624 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-6cc92ffe-c70b-423e-ac63-72a0d784e5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:08:11.478454 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 558/1125] 10.222.0.70 () {58 vars in 958 bytes} [Fri Aug 19 16:08:11 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:08:11.488799 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b6256-576e-46a0-ad37-fed2052d622d admin admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:08:11.490219 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-d32b6256-576e-46a0-ad37-fed2052d622d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:08:11.548509 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b6256-576e-46a0-ad37-fed2052d622d admin admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:08:11.552024 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d0d6a-5926-4d3d-9d6d-9f69e0e5f414 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5593ee9d30b4b65a215a4fe8dfba060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:08:11.552618 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d0d6a-5926-4d3d-9d6d-9f69e0e5f414 service neutron] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:08:11.552923 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d0d6a-5926-4d3d-9d6d-9f69e0e5f414 service neutron] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:08:11.553189 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d0d6a-5926-4d3d-9d6d-9f69e0e5f414 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:08:11.562190 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60d0d6a-5926-4d3d-9d6d-9f69e0e5f414 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:08:11.571771 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60d0d6a-5926-4d3d-9d6d-9f69e0e5f414 service neutron] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:08:11.573152 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 568/1126] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:08:11 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:08:12.092465 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc92ffe-c70b-423e-ac63-72a0d784e5b0 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:08:12.093943 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-6cc92ffe-c70b-423e-ac63-72a0d784e5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:08:12.108369 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc92ffe-c70b-423e-ac63-72a0d784e5b0 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:08:12.112220 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a6bd0e-3aa1-4974-9da7-a2e3c4d7a116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e72646e5274546c7b7216d7348ce3bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:08:12.113034 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a6bd0e-3aa1-4974-9da7-a2e3c4d7a116 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:08:12.113319 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a6bd0e-3aa1-4974-9da7-a2e3c4d7a116 admin admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:08:12.113590 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a6bd0e-3aa1-4974-9da7-a2e3c4d7a116 admin admin] PATH_INFO: `/v3/projects/41042c35e52046abb8f593bfb0bd3cff` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:08:12.114713 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a6bd0e-3aa1-4974-9da7-a2e3c4d7a116 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41042c35e52046abb8f593bfb0bd3cff)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:08:12.115806 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: WARNING py.warnings [None req-35a6bd0e-3aa1-4974-9da7-a2e3c4d7a116 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 16:08:12.115806 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: warnings.warn(msg) Aug 19 16:08:12.115806 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: Aug 19 16:08:12.116924 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a6bd0e-3aa1-4974-9da7-a2e3c4d7a116 admin admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:08:12.251173 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.notifications [None req-35a6bd0e-3aa1-4974-9da7-a2e3c4d7a116 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41042c35e52046abb8f593bfb0bd3cff', 'request_id': 'req-35a6bd0e-3aa1-4974-9da7-a2e3c4d7a116'} {{(pid=88367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:08:12.257222 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.notifications [None req-35a6bd0e-3aa1-4974-9da7-a2e3c4d7a116 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41042c35e52046abb8f593bfb0bd3cff', 'request_id': 'req-35a6bd0e-3aa1-4974-9da7-a2e3c4d7a116'} {{(pid=88367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:08:12.467224 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.notifications [None req-35a6bd0e-3aa1-4974-9da7-a2e3c4d7a116 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41042c35e52046abb8f593bfb0bd3cff', 'request_id': 'req-35a6bd0e-3aa1-4974-9da7-a2e3c4d7a116'} {{(pid=88367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:08:12.487721 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.notifications [None req-35a6bd0e-3aa1-4974-9da7-a2e3c4d7a116 admin admin] The token cache is being invalidate because project 41042c35e52046abb8f593bfb0bd3cff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:08:12.488011 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.notifications [None req-35a6bd0e-3aa1-4974-9da7-a2e3c4d7a116 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:08:12.488731 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.notifications [None req-35a6bd0e-3aa1-4974-9da7-a2e3c4d7a116 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:08:12.490450 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 559/1127] 10.222.0.70 () {58 vars in 1233 bytes} [Fri Aug 19 16:08:12 2022] DELETE /identity/v3/projects/41042c35e52046abb8f593bfb0bd3cff => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:08:21.568857 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:08:22.484493 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:09:40.511772 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6d6e8-6fbb-4126-a5cb-f2ebf5487de1 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:09:40.512361 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6d6e8-6fbb-4126-a5cb-f2ebf5487de1 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:09:40.512361 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6d6e8-6fbb-4126-a5cb-f2ebf5487de1 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:09:40.513693 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 569/1128] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 16:09:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:09:40.518475 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df24fd-4349-4144-926f-6f3f74473046 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:09:40.518916 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df24fd-4349-4144-926f-6f3f74473046 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:09:40.519029 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df24fd-4349-4144-926f-6f3f74473046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:09:40.539379 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-68df24fd-4349-4144-926f-6f3f74473046 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:09:40.540696 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-68df24fd-4349-4144-926f-6f3f74473046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:09:40.602475 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 560/1129] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 16:09:40 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:09:40.772124 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6d6e8-6fbb-4126-a5cb-f2ebf5487de1 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:09:40.773904 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-5ae6d6e8-6fbb-4126-a5cb-f2ebf5487de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:09:40.874053 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6d6e8-6fbb-4126-a5cb-f2ebf5487de1 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:09:40.879909 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe41309-2ed9-4a9a-bd39-590d74f5a40f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd90cec9e3ff64b5aa4cc867895b996ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:09:40.880522 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe41309-2ed9-4a9a-bd39-590d74f5a40f service nova] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:09:40.880831 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe41309-2ed9-4a9a-bd39-590d74f5a40f service nova] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:09:40.881100 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe41309-2ed9-4a9a-bd39-590d74f5a40f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:09:40.890293 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe41309-2ed9-4a9a-bd39-590d74f5a40f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:09:40.891873 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe41309-2ed9-4a9a-bd39-590d74f5a40f service nova] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:09:40.905633 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 570/1130] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:09:40 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:09:41.772340 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe5463-ece9-4b00-95f6-76b896630c94 None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:09:41.772983 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe5463-ece9-4b00-95f6-76b896630c94 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:09:41.773098 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe5463-ece9-4b00-95f6-76b896630c94 None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:09:41.774549 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 561/1131] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 16:09:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:09:41.780623 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d9cf9-1f82-4bf1-b9e3-4a9ea3c6e80d None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:09:41.781064 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d9cf9-1f82-4bf1-b9e3-4a9ea3c6e80d None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:09:41.781406 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d9cf9-1f82-4bf1-b9e3-4a9ea3c6e80d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:09:41.802729 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-3b5d9cf9-1f82-4bf1-b9e3-4a9ea3c6e80d None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:09:41.804398 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-3b5d9cf9-1f82-4bf1-b9e3-4a9ea3c6e80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:09:41.812184 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 571/1132] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 16:09:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:09:41.975108 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe5463-ece9-4b00-95f6-76b896630c94 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:09:41.989305 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe5463-ece9-4b00-95f6-76b896630c94 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:09:41.994935 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01100d8-a05e-4d08-b11c-67389ef6d48f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd90cec9e3ff64b5aa4cc867895b996ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:09:41.995623 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01100d8-a05e-4d08-b11c-67389ef6d48f service nova] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:09:41.995901 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01100d8-a05e-4d08-b11c-67389ef6d48f service nova] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:09:41.996173 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01100d8-a05e-4d08-b11c-67389ef6d48f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:09:42.008455 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01100d8-a05e-4d08-b11c-67389ef6d48f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:09:42.010941 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01100d8-a05e-4d08-b11c-67389ef6d48f service nova] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:09:42.021420 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 562/1133] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:09:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:09:46.478560 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e93240-7491-4738-bf0f-4b70795a97eb None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:09:46.479102 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e93240-7491-4738-bf0f-4b70795a97eb None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:09:46.479210 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e93240-7491-4738-bf0f-4b70795a97eb None None] PATH_INFO: `/v3` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:09:46.480698 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 572/1134] 10.222.0.65 () {54 vars in 925 bytes} [Fri Aug 19 16:09:46 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:09:46.486609 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f9f8d-5be6-415d-84a4-32779c28d680 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:09:46.487006 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f9f8d-5be6-415d-84a4-32779c28d680 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:09:46.487168 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f9f8d-5be6-415d-84a4-32779c28d680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:09:46.517939 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-304f9f8d-5be6-415d-84a4-32779c28d680 None None] MFA Rules not processed for user `580372230aad44269e3e0a7b230533f2`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:09:46.519118 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-304f9f8d-5be6-415d-84a4-32779c28d680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:09:46.584622 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 563/1135] 10.222.0.65 () {58 vars in 1015 bytes} [Fri Aug 19 16:09:46 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:09:50.931969 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1df9a-e0b4-4a45-93d1-0fe8c0144b8f None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:09:50.932488 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1df9a-e0b4-4a45-93d1-0fe8c0144b8f None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:09:50.932488 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1df9a-e0b4-4a45-93d1-0fe8c0144b8f None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:09:50.933751 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 573/1136] 10.222.0.70 () {54 vars in 961 bytes} [Fri Aug 19 16:09:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:09:50.939011 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c3b3e-2180-4f6f-ab06-83cb9cf92f83 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:09:50.939432 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c3b3e-2180-4f6f-ab06-83cb9cf92f83 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:09:50.939582 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c3b3e-2180-4f6f-ab06-83cb9cf92f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:09:50.959501 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-300c3b3e-2180-4f6f-ab06-83cb9cf92f83 None None] MFA Rules not processed for user `580372230aad44269e3e0a7b230533f2`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:09:50.960743 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-300c3b3e-2180-4f6f-ab06-83cb9cf92f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:09:50.970427 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 564/1137] 10.222.0.70 () {58 vars in 1058 bytes} [Fri Aug 19 16:09:50 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:09:51.042645 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea1df9a-e0b4-4a45-93d1-0fe8c0144b8f None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:09:51.057052 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea1df9a-e0b4-4a45-93d1-0fe8c0144b8f None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:09:51.062057 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d41557-2728-449b-b057-1a9749e57c62 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580372230aad44269e3e0a7b230533f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:09:51.062656 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d41557-2728-449b-b057-1a9749e57c62 service placement] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:09:51.062930 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d41557-2728-449b-b057-1a9749e57c62 service placement] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:09:51.063201 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d41557-2728-449b-b057-1a9749e57c62 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:09:51.072155 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d41557-2728-449b-b057-1a9749e57c62 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:09:51.073781 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d41557-2728-449b-b057-1a9749e57c62 service placement] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:09:51.083571 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 574/1138] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:09:51 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:09:53.254727 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97be1b-cadb-4bb4-8bc4-4a90ce2503d1 None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:09:53.255219 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97be1b-cadb-4bb4-8bc4-4a90ce2503d1 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:09:53.255219 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97be1b-cadb-4bb4-8bc4-4a90ce2503d1 None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:09:53.256565 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 565/1139] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 16:09:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:09:53.262690 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc2521-0527-4740-9bdb-7792ee360ad9 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:09:53.263542 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc2521-0527-4740-9bdb-7792ee360ad9 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:09:53.263820 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc2521-0527-4740-9bdb-7792ee360ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:09:53.291793 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-68fc2521-0527-4740-9bdb-7792ee360ad9 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:09:53.293074 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-68fc2521-0527-4740-9bdb-7792ee360ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:09:53.301158 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 575/1140] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 16:09:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:09:53.460246 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a97be1b-cadb-4bb4-8bc4-4a90ce2503d1 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:09:53.473876 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a97be1b-cadb-4bb4-8bc4-4a90ce2503d1 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:09:53.478913 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54138715-58ed-4a32-98fa-e9385a506231 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd90cec9e3ff64b5aa4cc867895b996ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:09:53.479497 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54138715-58ed-4a32-98fa-e9385a506231 service nova] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:09:53.479770 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54138715-58ed-4a32-98fa-e9385a506231 service nova] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:09:53.480038 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54138715-58ed-4a32-98fa-e9385a506231 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:09:53.488262 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54138715-58ed-4a32-98fa-e9385a506231 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:09:53.489874 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54138715-58ed-4a32-98fa-e9385a506231 service nova] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:09:53.499624 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 566/1141] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:09:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:09:54.332770 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33a12f-ed0e-4f27-ad7e-2b530e50f3cd None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:09:54.333296 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33a12f-ed0e-4f27-ad7e-2b530e50f3cd None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:09:54.333296 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33a12f-ed0e-4f27-ad7e-2b530e50f3cd None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:09:54.334726 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 576/1142] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 16:09:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:09:54.340387 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47533272-deb3-487d-b1b7-a9a016dca7b0 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:09:54.340864 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47533272-deb3-487d-b1b7-a9a016dca7b0 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:09:54.340992 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47533272-deb3-487d-b1b7-a9a016dca7b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:09:54.361526 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-47533272-deb3-487d-b1b7-a9a016dca7b0 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:09:54.362803 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-47533272-deb3-487d-b1b7-a9a016dca7b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:09:54.370843 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 567/1143] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 16:09:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:09:54.530411 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd33a12f-ed0e-4f27-ad7e-2b530e50f3cd None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:09:54.544061 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd33a12f-ed0e-4f27-ad7e-2b530e50f3cd None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:09:54.548984 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4371f-84b3-4951-be26-d8ab1e45f72a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd90cec9e3ff64b5aa4cc867895b996ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:09:54.549567 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4371f-84b3-4951-be26-d8ab1e45f72a service nova] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:09:54.549839 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4371f-84b3-4951-be26-d8ab1e45f72a service nova] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:09:54.550107 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4371f-84b3-4951-be26-d8ab1e45f72a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:09:54.558792 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e4371f-84b3-4951-be26-d8ab1e45f72a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:09:54.560355 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e4371f-84b3-4951-be26-d8ab1e45f72a service nova] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:09:54.569460 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 577/1144] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:09:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:09:58.887352 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0062f5c-a366-45b1-9edb-611f3f0440a1 None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:09:58.887947 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0062f5c-a366-45b1-9edb-611f3f0440a1 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:09:58.887947 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0062f5c-a366-45b1-9edb-611f3f0440a1 None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:09:58.889268 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 568/1145] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 16:09:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:09:58.894668 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985bd3f6-6e8b-43aa-9712-0ea68b7ac7ca None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:09:58.895117 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985bd3f6-6e8b-43aa-9712-0ea68b7ac7ca None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:09:58.895221 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985bd3f6-6e8b-43aa-9712-0ea68b7ac7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:09:58.914593 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-985bd3f6-6e8b-43aa-9712-0ea68b7ac7ca None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:09:58.916605 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-985bd3f6-6e8b-43aa-9712-0ea68b7ac7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:09:58.924554 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 578/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 16:09:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:09:59.272993 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0062f5c-a366-45b1-9edb-611f3f0440a1 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:09:59.275394 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-c0062f5c-a366-45b1-9edb-611f3f0440a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:09:59.329495 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:09:59.335766 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0062f5c-a366-45b1-9edb-611f3f0440a1 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:09:59.339384 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee91210-0414-46a8-83a2-55de45cc400c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5593ee9d30b4b65a215a4fe8dfba060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:09:59.344247 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee91210-0414-46a8-83a2-55de45cc400c service neutron] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:09:59.344247 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee91210-0414-46a8-83a2-55de45cc400c service neutron] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:09:59.344247 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee91210-0414-46a8-83a2-55de45cc400c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:09:59.350303 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee91210-0414-46a8-83a2-55de45cc400c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:09:59.351858 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee91210-0414-46a8-83a2-55de45cc400c service neutron] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:09:59.362318 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 569/1147] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:09:59 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:10:01.593014 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c6f0f-95fc-4fb8-8a3f-aff32a12d312 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:10:01.593635 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c6f0f-95fc-4fb8-8a3f-aff32a12d312 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:10:01.593635 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c6f0f-95fc-4fb8-8a3f-aff32a12d312 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:10:01.594880 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 579/1148] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 16:10:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:10:01.600589 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ce0fa-e133-42c3-a12b-908fc0817a9d None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:10:01.601097 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ce0fa-e133-42c3-a12b-908fc0817a9d None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:10:01.601277 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ce0fa-e133-42c3-a12b-908fc0817a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:10:01.622672 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-2e7ce0fa-e133-42c3-a12b-908fc0817a9d None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:10:01.623874 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-2e7ce0fa-e133-42c3-a12b-908fc0817a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:10:01.631913 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 570/1149] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 16:10:01 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:10:01.992438 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c6f0f-95fc-4fb8-8a3f-aff32a12d312 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:10:02.002270 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=54 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:10:02.004363 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c6f0f-95fc-4fb8-8a3f-aff32a12d312 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:10:02.007939 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d12f5-f6c7-4e27-a241-fad2217900c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5593ee9d30b4b65a215a4fe8dfba060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:10:02.009078 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d12f5-f6c7-4e27-a241-fad2217900c9 service neutron] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:10:02.009346 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d12f5-f6c7-4e27-a241-fad2217900c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:10:02.009613 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d12f5-f6c7-4e27-a241-fad2217900c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:10:02.019944 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247d12f5-f6c7-4e27-a241-fad2217900c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:10:02.021698 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247d12f5-f6c7-4e27-a241-fad2217900c9 service neutron] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:10:02.035500 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 580/1150] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:10:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:10:06.374867 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd6623-5c8a-47fd-97be-31313ab94546 None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:10:06.375407 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd6623-5c8a-47fd-97be-31313ab94546 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:10:06.375407 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd6623-5c8a-47fd-97be-31313ab94546 None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:10:06.376783 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 571/1151] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 16:10:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:10:06.382060 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e50df8-93c4-4067-80e5-8906b635184a None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:10:06.382514 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e50df8-93c4-4067-80e5-8906b635184a None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:10:06.382610 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e50df8-93c4-4067-80e5-8906b635184a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:10:06.403213 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-96e50df8-93c4-4067-80e5-8906b635184a None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:10:06.404427 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-96e50df8-93c4-4067-80e5-8906b635184a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:10:06.412446 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 581/1152] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 16:10:06 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:10:07.002332 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd6623-5c8a-47fd-97be-31313ab94546 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:10:07.003940 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-cacd6623-5c8a-47fd-97be-31313ab94546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:10:07.062024 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd6623-5c8a-47fd-97be-31313ab94546 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:10:07.065591 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0fac98-3dcd-47a7-9e71-b27cd2717d52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92eb2988fd86400dacb28eeef921a4b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:10:07.066202 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fac98-3dcd-47a7-9e71-b27cd2717d52 service cinder] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:10:07.066476 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fac98-3dcd-47a7-9e71-b27cd2717d52 service cinder] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:10:07.066747 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fac98-3dcd-47a7-9e71-b27cd2717d52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:10:07.076036 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0fac98-3dcd-47a7-9e71-b27cd2717d52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:10:07.077489 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0fac98-3dcd-47a7-9e71-b27cd2717d52 service cinder] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:10:07.087974 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 572/1153] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:10:07 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:10:09.368286 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe36ed-10e6-4d05-822e-dc63577f9017 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:10:09.368980 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe36ed-10e6-4d05-822e-dc63577f9017 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:10:09.368980 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe36ed-10e6-4d05-822e-dc63577f9017 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:10:09.370194 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 582/1154] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 16:10:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:10:09.375916 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857310b6-1efc-4e84-bcb4-406d9d0b12a4 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:10:09.376368 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857310b6-1efc-4e84-bcb4-406d9d0b12a4 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:10:09.376548 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857310b6-1efc-4e84-bcb4-406d9d0b12a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:10:09.397713 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-857310b6-1efc-4e84-bcb4-406d9d0b12a4 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:10:09.399537 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-857310b6-1efc-4e84-bcb4-406d9d0b12a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:10:09.408182 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 573/1155] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 16:10:09 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:10:10.003264 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe36ed-10e6-4d05-822e-dc63577f9017 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:10:10.005264 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-1dfe36ed-10e6-4d05-822e-dc63577f9017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:10:10.018756 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe36ed-10e6-4d05-822e-dc63577f9017 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:10:10.022377 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c7836-823a-4d0b-920a-310b591575a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92eb2988fd86400dacb28eeef921a4b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:10:10.022972 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c7836-823a-4d0b-920a-310b591575a3 service cinder] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:10:10.023245 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c7836-823a-4d0b-920a-310b591575a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:10:10.023513 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c7836-823a-4d0b-920a-310b591575a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:10:10.033553 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c7836-823a-4d0b-920a-310b591575a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:10:10.034974 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c7836-823a-4d0b-920a-310b591575a3 service cinder] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:10:10.046007 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 583/1156] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:10:10 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:10:19.391528 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=37 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:10:20.040999 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=14 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:11:26.457275 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20485e-4c00-4970-a1f6-77c76ecb5dc9 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:11:26.457903 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20485e-4c00-4970-a1f6-77c76ecb5dc9 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:11:26.458002 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4adaf-92b3-46d6-a7a7-c2568b54ede6 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:11:26.458402 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20485e-4c00-4970-a1f6-77c76ecb5dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:11:26.458507 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4adaf-92b3-46d6-a7a7-c2568b54ede6 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:11:26.458507 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4adaf-92b3-46d6-a7a7-c2568b54ede6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:11:26.478848 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-00e4adaf-92b3-46d6-a7a7-c2568b54ede6 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:11:26.479095 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-2e20485e-4c00-4970-a1f6-77c76ecb5dc9 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:11:26.480126 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-2e20485e-4c00-4970-a1f6-77c76ecb5dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:11:26.480405 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-00e4adaf-92b3-46d6-a7a7-c2568b54ede6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:11:26.488523 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 574/1157] 10.222.0.70 () {58 vars in 958 bytes} [Fri Aug 19 16:11:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:11:26.488874 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 584/1158] 10.222.0.70 () {58 vars in 958 bytes} [Fri Aug 19 16:11:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:11:26.496914 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16051d0-6c64-4da6-9f1a-b2c8ab996267 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:11:26.497145 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d195a-fad9-42ef-890a-aea4cf286d27 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:11:26.497316 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16051d0-6c64-4da6-9f1a-b2c8ab996267 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:11:26.497501 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d195a-fad9-42ef-890a-aea4cf286d27 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:11:26.497678 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d195a-fad9-42ef-890a-aea4cf286d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:11:26.497854 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16051d0-6c64-4da6-9f1a-b2c8ab996267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:11:26.517898 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-3b4d195a-fad9-42ef-890a-aea4cf286d27 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:11:26.518144 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-c16051d0-6c64-4da6-9f1a-b2c8ab996267 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:11:26.519113 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-3b4d195a-fad9-42ef-890a-aea4cf286d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:11:26.519228 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-c16051d0-6c64-4da6-9f1a-b2c8ab996267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:11:26.528022 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 575/1159] 10.222.0.70 () {58 vars in 958 bytes} [Fri Aug 19 16:11:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:11:26.528212 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 585/1160] 10.222.0.70 () {58 vars in 958 bytes} [Fri Aug 19 16:11:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:11:26.533036 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16051d0-6c64-4da6-9f1a-b2c8ab996267 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:11:26.533212 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d195a-fad9-42ef-890a-aea4cf286d27 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:11:26.543324 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16051d0-6c64-4da6-9f1a-b2c8ab996267 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:11:26.543569 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d195a-fad9-42ef-890a-aea4cf286d27 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:11:26.548046 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0599c3ae-fa94-44db-bf43-5e2146f2e7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e72646e5274546c7b7216d7348ce3bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:11:26.548280 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff1b5c7-e492-48e4-9eb1-ab2f3c2f812b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e72646e5274546c7b7216d7348ce3bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:11:26.548648 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599c3ae-fa94-44db-bf43-5e2146f2e7fc admin admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:11:26.548931 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1b5c7-e492-48e4-9eb1-ab2f3c2f812b admin admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:11:26.549072 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599c3ae-fa94-44db-bf43-5e2146f2e7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:11:26.549198 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599c3ae-fa94-44db-bf43-5e2146f2e7fc admin admin] PATH_INFO: `/v3/domains` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:11:26.549376 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1b5c7-e492-48e4-9eb1-ab2f3c2f812b admin admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:11:26.549482 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1b5c7-e492-48e4-9eb1-ab2f3c2f812b admin admin] PATH_INFO: `/v3/domains` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:11:26.549837 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0599c3ae-fa94-44db-bf43-5e2146f2e7fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:11:26.550095 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff1b5c7-e492-48e4-9eb1-ab2f3c2f812b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 16:11:26.550188 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0599c3ae-fa94-44db-bf43-5e2146f2e7fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:11:26.550394 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff1b5c7-e492-48e4-9eb1-ab2f3c2f812b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:11:26.551124 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: WARNING py.warnings [None req-0599c3ae-fa94-44db-bf43-5e2146f2e7fc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 16:11:26.551124 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: warnings.warn(msg) Aug 19 16:11:26.551124 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: Aug 19 16:11:26.552006 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0599c3ae-fa94-44db-bf43-5e2146f2e7fc admin admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:11:26.552115 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff1b5c7-e492-48e4-9eb1-ab2f3c2f812b admin admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:11:26.564539 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 576/1161] 10.222.0.70 () {58 vars in 1153 bytes} [Fri Aug 19 16:11:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 16:11:26.565199 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 586/1162] 10.222.0.70 () {58 vars in 1153 bytes} [Fri Aug 19 16:11:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 16:11:26.572795 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff1b5c7-e492-48e4-9eb1-ab2f3c2f812b admin admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:11:26.573292 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0599c3ae-fa94-44db-bf43-5e2146f2e7fc admin admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:11:26.583132 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0599c3ae-fa94-44db-bf43-5e2146f2e7fc admin admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:11:26.583311 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff1b5c7-e492-48e4-9eb1-ab2f3c2f812b admin admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:11:26.588348 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6f82b-b809-495f-a9a1-55096d2a399b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e72646e5274546c7b7216d7348ce3bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:11:26.588493 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6205d91-7e9a-4600-80f5-a32b9f96871d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e72646e5274546c7b7216d7348ce3bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:11:26.588973 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6f82b-b809-495f-a9a1-55096d2a399b admin admin] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:11:26.589088 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6205d91-7e9a-4600-80f5-a32b9f96871d admin admin] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:11:26.589247 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6f82b-b809-495f-a9a1-55096d2a399b admin admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:11:26.589483 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6205d91-7e9a-4600-80f5-a32b9f96871d admin admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:11:26.589588 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6f82b-b809-495f-a9a1-55096d2a399b admin admin] PATH_INFO: `/v3/projects` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:11:26.589765 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6205d91-7e9a-4600-80f5-a32b9f96871d admin admin] PATH_INFO: `/v3/projects` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:11:26.590239 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed6f82b-b809-495f-a9a1-55096d2a399b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:11:26.590379 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6205d91-7e9a-4600-80f5-a32b9f96871d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:11:26.591384 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: WARNING py.warnings [None req-f6205d91-7e9a-4600-80f5-a32b9f96871d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 16:11:26.591384 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: warnings.warn(msg) Aug 19 16:11:26.591384 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: Aug 19 16:11:26.592127 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed6f82b-b809-495f-a9a1-55096d2a399b admin admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:11:26.592577 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6205d91-7e9a-4600-80f5-a32b9f96871d admin admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:11:26.674810 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 587/1163] 10.222.0.70 () {60 vars in 1153 bytes} [Fri Aug 19 16:11:26 2022] POST /identity/v3/projects => generated 379 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 16:11:26.678850 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6f82b-b809-495f-a9a1-55096d2a399b admin admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:11:26.696617 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 577/1164] 10.222.0.70 () {60 vars in 1153 bytes} [Fri Aug 19 16:11:26 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:11:26.700890 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6205d91-7e9a-4600-80f5-a32b9f96871d admin admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:11:26.750204 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6f82b-b809-495f-a9a1-55096d2a399b admin admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:11:26.768742 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6205d91-7e9a-4600-80f5-a32b9f96871d admin admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:11:26.773541 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3424b3-da6b-4bd9-b4f0-b4c5d200e3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e72646e5274546c7b7216d7348ce3bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:11:26.774223 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3424b3-da6b-4bd9-b4f0-b4c5d200e3ce admin admin] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:11:26.774754 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3424b3-da6b-4bd9-b4f0-b4c5d200e3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:11:26.774891 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3424b3-da6b-4bd9-b4f0-b4c5d200e3ce admin admin] PATH_INFO: `/v3/users` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:11:26.775428 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3424b3-da6b-4bd9-b4f0-b4c5d200e3ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:11:26.777401 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3424b3-da6b-4bd9-b4f0-b4c5d200e3ce admin admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:11:26.810994 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b901b07-a5a6-413f-89c2-d4449aad3707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e72646e5274546c7b7216d7348ce3bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:11:26.811608 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b901b07-a5a6-413f-89c2-d4449aad3707 admin admin] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:11:26.811889 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b901b07-a5a6-413f-89c2-d4449aad3707 admin admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:11:26.812153 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b901b07-a5a6-413f-89c2-d4449aad3707 admin admin] PATH_INFO: `/v3/users` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:11:26.812823 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b901b07-a5a6-413f-89c2-d4449aad3707 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:11:26.813839 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: WARNING py.warnings [None req-1b901b07-a5a6-413f-89c2-d4449aad3707 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 16:11:26.813839 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: warnings.warn(msg) Aug 19 16:11:26.813839 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: Aug 19 16:11:26.815063 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b901b07-a5a6-413f-89c2-d4449aad3707 admin admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:11:26.862649 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 578/1165] 10.222.0.70 () {60 vars in 1144 bytes} [Fri Aug 19 16:11:26 2022] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 16:11:26.866823 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3424b3-da6b-4bd9-b4f0-b4c5d200e3ce admin admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:11:26.877890 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3424b3-da6b-4bd9-b4f0-b4c5d200e3ce admin admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:11:26.882598 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e034c31-f8ef-431a-a96f-70f94f5634c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e72646e5274546c7b7216d7348ce3bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:11:26.883332 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e034c31-f8ef-431a-a96f-70f94f5634c1 admin admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:11:26.883604 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e034c31-f8ef-431a-a96f-70f94f5634c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:11:26.883872 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e034c31-f8ef-431a-a96f-70f94f5634c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:11:26.884539 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e034c31-f8ef-431a-a96f-70f94f5634c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:11:26.886160 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e034c31-f8ef-431a-a96f-70f94f5634c1 admin admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:11:26.896354 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 579/1166] 10.222.0.70 () {58 vars in 1122 bytes} [Fri Aug 19 16:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 16:11:26.900692 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e034c31-f8ef-431a-a96f-70f94f5634c1 admin admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:11:26.910781 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e034c31-f8ef-431a-a96f-70f94f5634c1 admin admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:11:26.916338 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001eb881-7885-4c4b-beae-8dd233e35619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e72646e5274546c7b7216d7348ce3bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:11:26.916976 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001eb881-7885-4c4b-beae-8dd233e35619 admin admin] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:11:26.917254 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001eb881-7885-4c4b-beae-8dd233e35619 admin admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:11:26.917567 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001eb881-7885-4c4b-beae-8dd233e35619 admin admin] PATH_INFO: `/v3/roles` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:11:26.918210 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001eb881-7885-4c4b-beae-8dd233e35619 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:11:26.919809 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001eb881-7885-4c4b-beae-8dd233e35619 admin admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:11:26.931530 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 580/1167] 10.222.0.70 () {58 vars in 1122 bytes} [Fri Aug 19 16:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:11:26.935607 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001eb881-7885-4c4b-beae-8dd233e35619 admin admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:11:26.939215 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 588/1168] 10.222.0.70 () {60 vars in 1144 bytes} [Fri Aug 19 16:11:26 2022] POST /identity/v3/users => generated 290 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 16:11:26.942798 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b901b07-a5a6-413f-89c2-d4449aad3707 admin admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:11:26.945958 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001eb881-7885-4c4b-beae-8dd233e35619 admin admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:11:26.951187 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa24b1b-011c-4b8a-9cb9-5060edfa196d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e72646e5274546c7b7216d7348ce3bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:11:26.951855 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa24b1b-011c-4b8a-9cb9-5060edfa196d admin admin] REQUEST_METHOD: `PUT` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:11:26.952134 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa24b1b-011c-4b8a-9cb9-5060edfa196d admin admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:11:26.952409 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa24b1b-011c-4b8a-9cb9-5060edfa196d admin admin] PATH_INFO: `/v3/projects/84ca50dda4c040808c2fcd82fc0358d6/users/0be6f81a458345a899f185c255d79df9/roles/09971bc698e84205be000073fc048af2` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:11:26.953237 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b901b07-a5a6-413f-89c2-d4449aad3707 admin admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:11:26.958892 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc38d8-82f2-435a-8294-0fffd0d5c7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e72646e5274546c7b7216d7348ce3bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:11:26.959076 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc38d8-82f2-435a-8294-0fffd0d5c7b3 admin admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:11:26.959322 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc38d8-82f2-435a-8294-0fffd0d5c7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:11:26.959591 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc38d8-82f2-435a-8294-0fffd0d5c7b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:11:26.960217 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc38d8-82f2-435a-8294-0fffd0d5c7b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:11:26.962553 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc38d8-82f2-435a-8294-0fffd0d5c7b3 admin admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:11:26.970257 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa24b1b-011c-4b8a-9cb9-5060edfa196d admin admin] RBAC: Authorizing `identity:create_grant(project_id=84ca50dda4c040808c2fcd82fc0358d6, user_id=0be6f81a458345a899f185c255d79df9, role_id=09971bc698e84205be000073fc048af2)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:11:26.971299 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: WARNING py.warnings [None req-0aa24b1b-011c-4b8a-9cb9-5060edfa196d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 16:11:26.971299 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: warnings.warn(msg) Aug 19 16:11:26.971299 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: Aug 19 16:11:26.972933 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 589/1169] 10.222.0.70 () {58 vars in 1122 bytes} [Fri Aug 19 16:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 16:11:26.973263 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa24b1b-011c-4b8a-9cb9-5060edfa196d admin admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:11:26.977704 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc38d8-82f2-435a-8294-0fffd0d5c7b3 admin admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:11:26.987885 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc38d8-82f2-435a-8294-0fffd0d5c7b3 admin admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:11:26.993863 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aabb67-c105-4dc1-b2c6-8b951308fbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e72646e5274546c7b7216d7348ce3bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:11:26.994462 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aabb67-c105-4dc1-b2c6-8b951308fbe2 admin admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:11:26.994764 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aabb67-c105-4dc1-b2c6-8b951308fbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:11:26.995031 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aabb67-c105-4dc1-b2c6-8b951308fbe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:11:26.995663 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aabb67-c105-4dc1-b2c6-8b951308fbe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:11:26.997274 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aabb67-c105-4dc1-b2c6-8b951308fbe2 admin admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:11:27.008024 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 590/1170] 10.222.0.70 () {58 vars in 1122 bytes} [Fri Aug 19 16:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 16:11:27.012265 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aabb67-c105-4dc1-b2c6-8b951308fbe2 admin admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:11:27.022377 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aabb67-c105-4dc1-b2c6-8b951308fbe2 admin admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:11:27.027994 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec1305-420f-410d-88dc-ad4431af7559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e72646e5274546c7b7216d7348ce3bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:11:27.028651 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec1305-420f-410d-88dc-ad4431af7559 admin admin] REQUEST_METHOD: `PUT` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:11:27.028954 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec1305-420f-410d-88dc-ad4431af7559 admin admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:11:27.029227 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec1305-420f-410d-88dc-ad4431af7559 admin admin] PATH_INFO: `/v3/projects/9d34bbc3043c4333b1f57b3d260fbb49/users/cfb40baf633d4930a372f464c701bd8f/roles/09971bc698e84205be000073fc048af2` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:11:27.045685 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ec1305-420f-410d-88dc-ad4431af7559 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d34bbc3043c4333b1f57b3d260fbb49, user_id=cfb40baf633d4930a372f464c701bd8f, role_id=09971bc698e84205be000073fc048af2)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:11:27.046464 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 581/1171] 10.222.0.70 () {60 vars in 1483 bytes} [Fri Aug 19 16:11:26 2022] PUT /identity/v3/projects/84ca50dda4c040808c2fcd82fc0358d6/users/0be6f81a458345a899f185c255d79df9/roles/09971bc698e84205be000073fc048af2 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:11:27.048384 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ec1305-420f-410d-88dc-ad4431af7559 admin admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:11:27.051852 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc0ed5-b08c-4ac9-a740-375307a58059 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:11:27.052120 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc0ed5-b08c-4ac9-a740-375307a58059 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:11:27.052395 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc0ed5-b08c-4ac9-a740-375307a58059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:11:27.072841 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-48fc0ed5-b08c-4ac9-a740-375307a58059 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:11:27.074098 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-48fc0ed5-b08c-4ac9-a740-375307a58059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:11:27.119487 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 591/1172] 10.222.0.70 () {60 vars in 1483 bytes} [Fri Aug 19 16:11:27 2022] PUT /identity/v3/projects/9d34bbc3043c4333b1f57b3d260fbb49/users/cfb40baf633d4930a372f464c701bd8f/roles/09971bc698e84205be000073fc048af2 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:11:27.124541 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c951a7-080a-4556-868f-b9b830d09e05 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:11:27.124853 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c951a7-080a-4556-868f-b9b830d09e05 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:11:27.125127 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c951a7-080a-4556-868f-b9b830d09e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:11:27.127253 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:11:27.132339 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:11:27.138836 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 582/1173] 10.222.0.70 () {58 vars in 958 bytes} [Fri Aug 19 16:11:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:11:27.146222 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-c0c951a7-080a-4556-868f-b9b830d09e05 None None] MFA Rules not processed for user `39fb10cdfa334097bc6eed362d01249d`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:11:27.147269 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-c0c951a7-080a-4556-868f-b9b830d09e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:11:27.150178 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc0ed5-b08c-4ac9-a740-375307a58059 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:11:27.204883 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc0ed5-b08c-4ac9-a740-375307a58059 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:11:27.209838 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 592/1174] 10.222.0.70 () {58 vars in 958 bytes} [Fri Aug 19 16:11:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:11:27.221061 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c951a7-080a-4556-868f-b9b830d09e05 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:11:27.259013 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d113f6bc-387f-44d6-a52b-1261cec02c55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5593ee9d30b4b65a215a4fe8dfba060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:11:27.259590 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d113f6bc-387f-44d6-a52b-1261cec02c55 service neutron] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:11:27.259875 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d113f6bc-387f-44d6-a52b-1261cec02c55 service neutron] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:11:27.260147 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d113f6bc-387f-44d6-a52b-1261cec02c55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:11:27.269954 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d113f6bc-387f-44d6-a52b-1261cec02c55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:11:27.271387 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d113f6bc-387f-44d6-a52b-1261cec02c55 service neutron] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:11:27.280482 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c951a7-080a-4556-868f-b9b830d09e05 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:11:27.283892 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 583/1175] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:11:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 16:11:27.285378 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e4e37-c8eb-444d-b399-203d7a451249 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5593ee9d30b4b65a215a4fe8dfba060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:11:27.286008 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e4e37-c8eb-444d-b399-203d7a451249 service neutron] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:11:27.286285 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e4e37-c8eb-444d-b399-203d7a451249 service neutron] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:11:27.286556 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e4e37-c8eb-444d-b399-203d7a451249 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:11:27.298476 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3e4e37-c8eb-444d-b399-203d7a451249 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:11:27.300077 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3e4e37-c8eb-444d-b399-203d7a451249 service neutron] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:11:27.310406 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 593/1176] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:11:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 16:11:33.629242 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df791c-620b-4faa-9f7f-73c067da44f5 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:11:33.629782 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df791c-620b-4faa-9f7f-73c067da44f5 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:11:33.629888 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df791c-620b-4faa-9f7f-73c067da44f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:11:33.663575 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-b6df791c-620b-4faa-9f7f-73c067da44f5 None None] MFA Rules not processed for user `0be6f81a458345a899f185c255d79df9`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:11:33.665540 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-b6df791c-620b-4faa-9f7f-73c067da44f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:11:33.747709 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 584/1177] 10.222.0.70 () {58 vars in 958 bytes} [Fri Aug 19 16:11:33 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:11:33.752755 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e4e37-c8eb-444d-b399-203d7a451249 service neutron] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:11:33.775367 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e4e37-c8eb-444d-b399-203d7a451249 service neutron] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:11:33.782887 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be0087d-55b9-40af-b210-a6014146df8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e72646e5274546c7b7216d7348ce3bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:11:33.783826 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0087d-55b9-40af-b210-a6014146df8a admin admin] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:11:33.784739 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0087d-55b9-40af-b210-a6014146df8a admin admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:11:33.785058 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0087d-55b9-40af-b210-a6014146df8a admin admin] PATH_INFO: `/v3/projects` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:11:33.785835 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be0087d-55b9-40af-b210-a6014146df8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:11:33.787864 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be0087d-55b9-40af-b210-a6014146df8a admin admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:11:33.884223 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 594/1178] 10.222.0.70 () {60 vars in 1153 bytes} [Fri Aug 19 16:11:33 2022] POST /identity/v3/projects => generated 385 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:11:33.887967 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df791c-620b-4faa-9f7f-73c067da44f5 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:11:33.899743 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df791c-620b-4faa-9f7f-73c067da44f5 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:11:33.968300 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=100 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:11:33.986761 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f490a16e-6e95-417a-8f6f-c6430dfe500d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e72646e5274546c7b7216d7348ce3bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:11:33.987546 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490a16e-6e95-417a-8f6f-c6430dfe500d admin admin] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:11:33.987693 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490a16e-6e95-417a-8f6f-c6430dfe500d admin admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:11:33.987969 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490a16e-6e95-417a-8f6f-c6430dfe500d admin admin] PATH_INFO: `/v3/users` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:11:33.988608 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f490a16e-6e95-417a-8f6f-c6430dfe500d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:11:33.990582 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f490a16e-6e95-417a-8f6f-c6430dfe500d admin admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:11:34.098198 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 585/1179] 10.222.0.70 () {60 vars in 1144 bytes} [Fri Aug 19 16:11:33 2022] POST /identity/v3/users => generated 299 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 16:11:34.105132 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be0087d-55b9-40af-b210-a6014146df8a admin admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:11:34.123381 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be0087d-55b9-40af-b210-a6014146df8a admin admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:11:34.129083 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f63b9-5f46-4413-9d72-5b456ded41e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e72646e5274546c7b7216d7348ce3bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:11:34.129789 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f63b9-5f46-4413-9d72-5b456ded41e9 admin admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:11:34.130160 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f63b9-5f46-4413-9d72-5b456ded41e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:11:34.130495 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f63b9-5f46-4413-9d72-5b456ded41e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:11:34.131168 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85f63b9-5f46-4413-9d72-5b456ded41e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:11:34.133530 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85f63b9-5f46-4413-9d72-5b456ded41e9 admin admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:11:34.163693 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 595/1180] 10.222.0.70 () {58 vars in 1122 bytes} [Fri Aug 19 16:11:34 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:11:34.166403 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f490a16e-6e95-417a-8f6f-c6430dfe500d admin admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:11:34.177790 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f490a16e-6e95-417a-8f6f-c6430dfe500d admin admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:11:34.183485 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0335f11a-03d7-4b57-9499-b7ba58cb7fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e72646e5274546c7b7216d7348ce3bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:11:34.184175 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335f11a-03d7-4b57-9499-b7ba58cb7fe5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:11:34.184455 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335f11a-03d7-4b57-9499-b7ba58cb7fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:11:34.187043 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335f11a-03d7-4b57-9499-b7ba58cb7fe5 admin admin] PATH_INFO: `/v3/projects/dcb65b6a4715460cbb428704328995d0/users/19bfeb8ccdc84f41ba2ca50d644af79a/roles/2f6cb7d6ec874879972a12a63d61068d` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:11:34.222054 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0335f11a-03d7-4b57-9499-b7ba58cb7fe5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcb65b6a4715460cbb428704328995d0, user_id=19bfeb8ccdc84f41ba2ca50d644af79a, role_id=2f6cb7d6ec874879972a12a63d61068d)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:11:34.227714 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0335f11a-03d7-4b57-9499-b7ba58cb7fe5 admin admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:11:34.305841 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 586/1181] 10.222.0.70 () {60 vars in 1483 bytes} [Fri Aug 19 16:11:34 2022] PUT /identity/v3/projects/dcb65b6a4715460cbb428704328995d0/users/19bfeb8ccdc84f41ba2ca50d644af79a/roles/2f6cb7d6ec874879972a12a63d61068d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:11:34.325595 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f63b9-5f46-4413-9d72-5b456ded41e9 admin admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:11:34.369293 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15086902-a4f6-45b7-9ad9-b80566489743 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:11:34.369834 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15086902-a4f6-45b7-9ad9-b80566489743 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:11:34.370657 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15086902-a4f6-45b7-9ad9-b80566489743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:11:34.373106 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f63b9-5f46-4413-9d72-5b456ded41e9 admin admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:11:34.435212 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-15086902-a4f6-45b7-9ad9-b80566489743 None None] MFA Rules not processed for user `cfb40baf633d4930a372f464c701bd8f`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:11:34.437191 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-15086902-a4f6-45b7-9ad9-b80566489743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:11:34.484411 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95123acc-83d3-407e-b88f-db7b63e636ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e72646e5274546c7b7216d7348ce3bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:11:34.486486 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95123acc-83d3-407e-b88f-db7b63e636ad admin admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:11:34.487196 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95123acc-83d3-407e-b88f-db7b63e636ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:11:34.488282 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95123acc-83d3-407e-b88f-db7b63e636ad admin admin] PATH_INFO: `/v3/roles` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:11:34.489880 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95123acc-83d3-407e-b88f-db7b63e636ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:11:34.494037 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95123acc-83d3-407e-b88f-db7b63e636ad admin admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:11:34.518422 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 596/1182] 10.222.0.70 () {58 vars in 1122 bytes} [Fri Aug 19 16:11:34 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:11:34.522989 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95123acc-83d3-407e-b88f-db7b63e636ad admin admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:11:34.535642 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95123acc-83d3-407e-b88f-db7b63e636ad admin admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:11:34.543108 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35a462-23e4-43a3-89bf-f22d51765027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e72646e5274546c7b7216d7348ce3bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:11:34.544107 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35a462-23e4-43a3-89bf-f22d51765027 admin admin] REQUEST_METHOD: `PUT` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:11:34.544588 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35a462-23e4-43a3-89bf-f22d51765027 admin admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:11:34.545121 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35a462-23e4-43a3-89bf-f22d51765027 admin admin] PATH_INFO: `/v3/projects/dcb65b6a4715460cbb428704328995d0/users/19bfeb8ccdc84f41ba2ca50d644af79a/roles/2f6cb7d6ec874879972a12a63d61068d` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:11:34.547858 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f35a462-23e4-43a3-89bf-f22d51765027 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcb65b6a4715460cbb428704328995d0, user_id=19bfeb8ccdc84f41ba2ca50d644af79a, role_id=2f6cb7d6ec874879972a12a63d61068d)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:11:34.551072 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f35a462-23e4-43a3-89bf-f22d51765027 admin admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:11:34.557591 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:11:34.565467 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 597/1183] 10.222.0.70 () {60 vars in 1483 bytes} [Fri Aug 19 16:11:34 2022] PUT /identity/v3/projects/dcb65b6a4715460cbb428704328995d0/users/19bfeb8ccdc84f41ba2ca50d644af79a/roles/2f6cb7d6ec874879972a12a63d61068d => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:11:34.587382 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 587/1184] 10.222.0.70 () {58 vars in 958 bytes} [Fri Aug 19 16:11:34 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:11:34.592733 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35a462-23e4-43a3-89bf-f22d51765027 admin admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:11:34.681757 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35a462-23e4-43a3-89bf-f22d51765027 admin admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:11:34.687380 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff93304d-63f6-4e8c-9dfc-957b4db25316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e72646e5274546c7b7216d7348ce3bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:11:34.688005 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93304d-63f6-4e8c-9dfc-957b4db25316 admin admin] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:11:34.688287 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93304d-63f6-4e8c-9dfc-957b4db25316 admin admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:11:34.688544 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93304d-63f6-4e8c-9dfc-957b4db25316 admin admin] PATH_INFO: `/v3/projects` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:11:34.689216 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff93304d-63f6-4e8c-9dfc-957b4db25316 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:11:34.691487 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff93304d-63f6-4e8c-9dfc-957b4db25316 admin admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:11:34.839688 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 598/1185] 10.222.0.70 () {60 vars in 1153 bytes} [Fri Aug 19 16:11:34 2022] POST /identity/v3/projects => generated 375 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:11:34.843969 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15086902-a4f6-45b7-9ad9-b80566489743 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:11:34.859434 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15086902-a4f6-45b7-9ad9-b80566489743 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:11:34.974929 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68844ffa-dd78-4b3c-b8ae-e3c348c067c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e72646e5274546c7b7216d7348ce3bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:11:34.976174 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68844ffa-dd78-4b3c-b8ae-e3c348c067c6 admin admin] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:11:34.977258 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68844ffa-dd78-4b3c-b8ae-e3c348c067c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:11:34.977703 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68844ffa-dd78-4b3c-b8ae-e3c348c067c6 admin admin] PATH_INFO: `/v3/users` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:11:34.978485 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68844ffa-dd78-4b3c-b8ae-e3c348c067c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:11:34.980591 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68844ffa-dd78-4b3c-b8ae-e3c348c067c6 admin admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:11:35.069413 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 588/1186] 10.222.0.70 () {60 vars in 1144 bytes} [Fri Aug 19 16:11:34 2022] POST /identity/v3/users => generated 294 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 16:11:35.073261 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff93304d-63f6-4e8c-9dfc-957b4db25316 admin admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:11:35.089918 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff93304d-63f6-4e8c-9dfc-957b4db25316 admin admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:11:35.095264 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff3524-0d55-4a6e-a699-63a0db822c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e72646e5274546c7b7216d7348ce3bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:11:35.095964 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff3524-0d55-4a6e-a699-63a0db822c51 admin admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:11:35.096562 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff3524-0d55-4a6e-a699-63a0db822c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:11:35.096929 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff3524-0d55-4a6e-a699-63a0db822c51 admin admin] PATH_INFO: `/v3/roles` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:11:35.097682 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff3524-0d55-4a6e-a699-63a0db822c51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:11:35.099361 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff3524-0d55-4a6e-a699-63a0db822c51 admin admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:11:35.113125 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 599/1187] 10.222.0.70 () {58 vars in 1122 bytes} [Fri Aug 19 16:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:11:35.118039 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68844ffa-dd78-4b3c-b8ae-e3c348c067c6 admin admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:11:35.130378 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68844ffa-dd78-4b3c-b8ae-e3c348c067c6 admin admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:11:35.136574 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d01d7-f5dc-4426-a41c-6572d1525d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e72646e5274546c7b7216d7348ce3bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:11:35.137447 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d01d7-f5dc-4426-a41c-6572d1525d16 admin admin] REQUEST_METHOD: `PUT` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:11:35.137710 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d01d7-f5dc-4426-a41c-6572d1525d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:11:35.138048 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d01d7-f5dc-4426-a41c-6572d1525d16 admin admin] PATH_INFO: `/v3/projects/3d02fde425ed4c78b5ce9592703f8837/users/175158bac664482d8e784ce250707fe0/roles/2f6cb7d6ec874879972a12a63d61068d` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:11:35.158984 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4d01d7-f5dc-4426-a41c-6572d1525d16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d02fde425ed4c78b5ce9592703f8837, user_id=175158bac664482d8e784ce250707fe0, role_id=2f6cb7d6ec874879972a12a63d61068d)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:11:35.161136 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4d01d7-f5dc-4426-a41c-6572d1525d16 admin admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:11:35.230927 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 589/1188] 10.222.0.70 () {60 vars in 1483 bytes} [Fri Aug 19 16:11:35 2022] PUT /identity/v3/projects/3d02fde425ed4c78b5ce9592703f8837/users/175158bac664482d8e784ce250707fe0/roles/2f6cb7d6ec874879972a12a63d61068d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 16:11:35.235466 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff3524-0d55-4a6e-a699-63a0db822c51 admin admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:11:35.250164 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff3524-0d55-4a6e-a699-63a0db822c51 admin admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:11:35.338425 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915bbfc-d6fa-47b8-a5ce-bb67210dba59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e72646e5274546c7b7216d7348ce3bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:11:35.339151 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915bbfc-d6fa-47b8-a5ce-bb67210dba59 admin admin] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:11:35.339433 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915bbfc-d6fa-47b8-a5ce-bb67210dba59 admin admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:11:35.339748 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915bbfc-d6fa-47b8-a5ce-bb67210dba59 admin admin] PATH_INFO: `/v3/roles` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:11:35.340542 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1915bbfc-d6fa-47b8-a5ce-bb67210dba59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:11:35.343002 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1915bbfc-d6fa-47b8-a5ce-bb67210dba59 admin admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:11:35.360271 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 600/1189] 10.222.0.70 () {58 vars in 1122 bytes} [Fri Aug 19 16:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 16:11:35.364416 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d01d7-f5dc-4426-a41c-6572d1525d16 admin admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:11:35.374738 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:11:35.380349 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d01d7-f5dc-4426-a41c-6572d1525d16 admin admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:11:35.387320 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6c5447-20dc-4231-825e-77e6a5e9e2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e72646e5274546c7b7216d7348ce3bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:11:35.389223 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c5447-20dc-4231-825e-77e6a5e9e2a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:11:35.389223 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c5447-20dc-4231-825e-77e6a5e9e2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:11:35.389223 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c5447-20dc-4231-825e-77e6a5e9e2a6 admin admin] PATH_INFO: `/v3/projects/3d02fde425ed4c78b5ce9592703f8837/users/175158bac664482d8e784ce250707fe0/roles/2f6cb7d6ec874879972a12a63d61068d` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:11:35.390831 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6c5447-20dc-4231-825e-77e6a5e9e2a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d02fde425ed4c78b5ce9592703f8837, user_id=175158bac664482d8e784ce250707fe0, role_id=2f6cb7d6ec874879972a12a63d61068d)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:11:35.394184 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6c5447-20dc-4231-825e-77e6a5e9e2a6 admin admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:11:35.406925 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 590/1190] 10.222.0.70 () {60 vars in 1483 bytes} [Fri Aug 19 16:11:35 2022] PUT /identity/v3/projects/3d02fde425ed4c78b5ce9592703f8837/users/175158bac664482d8e784ce250707fe0/roles/2f6cb7d6ec874879972a12a63d61068d => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:11:41.981122 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c90e26-ad39-4a76-a615-be84442d9776 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:11:41.983312 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c90e26-ad39-4a76-a615-be84442d9776 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:11:41.983777 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c90e26-ad39-4a76-a615-be84442d9776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:11:42.024790 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-78c90e26-ad39-4a76-a615-be84442d9776 None None] MFA Rules not processed for user `19bfeb8ccdc84f41ba2ca50d644af79a`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:11:42.026455 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-78c90e26-ad39-4a76-a615-be84442d9776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:11:42.091962 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:11:42.113882 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 601/1191] 10.222.0.70 () {58 vars in 958 bytes} [Fri Aug 19 16:11:41 2022] POST /identity/v3/auth/tokens => generated 2889 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:11:42.126273 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6c5447-20dc-4231-825e-77e6a5e9e2a6 admin admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:11:42.129253 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-ba6c5447-20dc-4231-825e-77e6a5e9e2a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:11:42.246738 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6c5447-20dc-4231-825e-77e6a5e9e2a6 admin admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:11:42.251111 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44fd2d-1044-4eb5-b889-d1c2877a5142 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d70aff7f0a448bb9a5cc2b78c828590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:11:42.251902 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44fd2d-1044-4eb5-b889-d1c2877a5142 service glance] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:11:42.252289 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44fd2d-1044-4eb5-b889-d1c2877a5142 service glance] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:11:42.252624 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44fd2d-1044-4eb5-b889-d1c2877a5142 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:11:42.342005 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f44fd2d-1044-4eb5-b889-d1c2877a5142 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:11:42.343660 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f44fd2d-1044-4eb5-b889-d1c2877a5142 service glance] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:11:42.378112 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 591/1192] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:11:42 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:11:42.504657 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d0324-fa2b-4395-b3bf-30925c03ccd2 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:11:42.504970 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d0324-fa2b-4395-b3bf-30925c03ccd2 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:11:42.505244 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d0324-fa2b-4395-b3bf-30925c03ccd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:11:42.542147 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-228d0324-fa2b-4395-b3bf-30925c03ccd2 None None] MFA Rules not processed for user `175158bac664482d8e784ce250707fe0`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:11:42.543360 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-228d0324-fa2b-4395-b3bf-30925c03ccd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:11:42.635214 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 602/1193] 10.222.0.70 () {58 vars in 958 bytes} [Fri Aug 19 16:11:42 2022] POST /identity/v3/auth/tokens => generated 2879 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:11:42.647936 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44fd2d-1044-4eb5-b889-d1c2877a5142 service glance] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:11:42.657669 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44fd2d-1044-4eb5-b889-d1c2877a5142 service glance] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:11:42.661648 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077e95fb-d2b5-45a7-9ccc-b39ffcfbca07 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d70aff7f0a448bb9a5cc2b78c828590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:11:42.662213 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e95fb-d2b5-45a7-9ccc-b39ffcfbca07 service glance] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:11:42.662486 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e95fb-d2b5-45a7-9ccc-b39ffcfbca07 service glance] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:11:42.662752 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e95fb-d2b5-45a7-9ccc-b39ffcfbca07 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:11:42.732065 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077e95fb-d2b5-45a7-9ccc-b39ffcfbca07 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:11:42.733849 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077e95fb-d2b5-45a7-9ccc-b39ffcfbca07 service glance] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:11:42.752752 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 592/1194] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:11:42 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:11:51.984305 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417bc661-2c39-4c24-9b76-ab51e12f6634 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:11:51.984932 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417bc661-2c39-4c24-9b76-ab51e12f6634 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:11:51.985259 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417bc661-2c39-4c24-9b76-ab51e12f6634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:11:52.009498 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-417bc661-2c39-4c24-9b76-ab51e12f6634 None None] MFA Rules not processed for user `0be6f81a458345a899f185c255d79df9`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:11:52.010820 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-417bc661-2c39-4c24-9b76-ab51e12f6634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:11:52.020913 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 603/1195] 10.222.0.70 () {58 vars in 958 bytes} [Fri Aug 19 16:11:51 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:11:52.350657 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc2dae-40d0-427d-9ca2-da14cc8fee44 None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:11:52.351202 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc2dae-40d0-427d-9ca2-da14cc8fee44 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:11:52.351616 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc2dae-40d0-427d-9ca2-da14cc8fee44 None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:11:52.356306 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 593/1196] 10.222.0.70 () {54 vars in 962 bytes} [Fri Aug 19 16:11:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:11:52.363317 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398cfb9a-7d36-4e98-9433-56e9bc96c32a None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:11:52.363600 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398cfb9a-7d36-4e98-9433-56e9bc96c32a None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:11:52.363969 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398cfb9a-7d36-4e98-9433-56e9bc96c32a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:11:52.388268 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-398cfb9a-7d36-4e98-9433-56e9bc96c32a None None] MFA Rules not processed for user `d90cec9e3ff64b5aa4cc867895b996ad`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:11:52.389663 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-398cfb9a-7d36-4e98-9433-56e9bc96c32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:11:52.488829 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 604/1197] 10.222.0.70 () {58 vars in 1059 bytes} [Fri Aug 19 16:11:52 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:11:52.490875 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61ccf6-dc4b-431e-bd3b-5d13df99435f None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:11:52.491351 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61ccf6-dc4b-431e-bd3b-5d13df99435f None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:11:52.491690 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61ccf6-dc4b-431e-bd3b-5d13df99435f None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:11:52.493952 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 594/1198] 10.222.0.70 () {54 vars in 912 bytes} [Fri Aug 19 16:11:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:11:52.499292 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa20fe3-bbd6-4dfd-9b52-10137d31d1b7 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:11:52.499673 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa20fe3-bbd6-4dfd-9b52-10137d31d1b7 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:11:52.500013 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa20fe3-bbd6-4dfd-9b52-10137d31d1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:11:52.521854 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-8fa20fe3-bbd6-4dfd-9b52-10137d31d1b7 None None] MFA Rules not processed for user `d90cec9e3ff64b5aa4cc867895b996ad`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:11:52.523881 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-8fa20fe3-bbd6-4dfd-9b52-10137d31d1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:11:52.533629 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 605/1199] 10.222.0.70 () {58 vars in 1009 bytes} [Fri Aug 19 16:11:52 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:11:52.545823 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b61ccf6-dc4b-431e-bd3b-5d13df99435f None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:11:52.549585 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-5b61ccf6-dc4b-431e-bd3b-5d13df99435f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:11:52.563844 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b61ccf6-dc4b-431e-bd3b-5d13df99435f None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:11:52.568028 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e83d4a4-ea77-43cf-9f4a-d534f6b64abc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d70aff7f0a448bb9a5cc2b78c828590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:11:52.568827 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83d4a4-ea77-43cf-9f4a-d534f6b64abc service glance] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:11:52.569168 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83d4a4-ea77-43cf-9f4a-d534f6b64abc service glance] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:11:52.569506 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83d4a4-ea77-43cf-9f4a-d534f6b64abc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:11:52.590646 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e83d4a4-ea77-43cf-9f4a-d534f6b64abc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:11:52.592404 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e83d4a4-ea77-43cf-9f4a-d534f6b64abc service glance] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:11:52.604698 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 595/1200] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:11:52 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:11:53.064984 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398426cd-6d85-4ed2-b7a8-082ac62f0e26 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:11:53.065524 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398426cd-6d85-4ed2-b7a8-082ac62f0e26 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:11:53.065524 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398426cd-6d85-4ed2-b7a8-082ac62f0e26 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:11:53.066913 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 606/1201] 10.222.0.70 () {54 vars in 912 bytes} [Fri Aug 19 16:11:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:11:53.072406 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83607e28-a4a5-4584-aaa7-06fdb0bbee3f None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:11:53.072712 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83607e28-a4a5-4584-aaa7-06fdb0bbee3f None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:11:53.072983 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83607e28-a4a5-4584-aaa7-06fdb0bbee3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:11:53.093022 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-83607e28-a4a5-4584-aaa7-06fdb0bbee3f None None] MFA Rules not processed for user `f5593ee9d30b4b65a215a4fe8dfba060`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:11:53.094268 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-83607e28-a4a5-4584-aaa7-06fdb0bbee3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:11:53.122681 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:11:53.150529 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 596/1202] 10.222.0.70 () {58 vars in 1009 bytes} [Fri Aug 19 16:11:53 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:11:53.161511 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398426cd-6d85-4ed2-b7a8-082ac62f0e26 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:11:53.164734 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-398426cd-6d85-4ed2-b7a8-082ac62f0e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:11:53.177823 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398426cd-6d85-4ed2-b7a8-082ac62f0e26 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:11:53.184258 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99915b39-d0e2-44ae-bcd7-a7c486a3601c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5593ee9d30b4b65a215a4fe8dfba060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:11:53.184258 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99915b39-d0e2-44ae-bcd7-a7c486a3601c service neutron] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:11:53.184258 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99915b39-d0e2-44ae-bcd7-a7c486a3601c service neutron] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:11:53.184258 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99915b39-d0e2-44ae-bcd7-a7c486a3601c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:11:53.190544 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99915b39-d0e2-44ae-bcd7-a7c486a3601c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:11:53.192492 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99915b39-d0e2-44ae-bcd7-a7c486a3601c service neutron] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:11:53.200177 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 607/1203] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:11:53 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:11:53.705567 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3335e-d033-4f9e-909a-df27c9c154d8 None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:11:53.706084 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3335e-d033-4f9e-909a-df27c9c154d8 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:11:53.706084 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3335e-d033-4f9e-909a-df27c9c154d8 None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:11:53.707556 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 597/1204] 10.222.0.70 () {54 vars in 962 bytes} [Fri Aug 19 16:11:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:11:53.713703 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532900b-7f0d-47c0-9274-07521f11a04d None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:11:53.714216 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532900b-7f0d-47c0-9274-07521f11a04d None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:11:53.714498 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532900b-7f0d-47c0-9274-07521f11a04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:11:53.730377 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c50924-0775-42c7-9d4e-4046b7f5f612 None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:11:53.730759 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c50924-0775-42c7-9d4e-4046b7f5f612 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:11:53.731100 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c50924-0775-42c7-9d4e-4046b7f5f612 None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:11:53.732844 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 598/1205] 10.222.0.70 () {54 vars in 961 bytes} [Fri Aug 19 16:11:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 16:11:53.738538 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab973000-63a5-464c-835a-f93ec03e1d1c None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:11:53.738822 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab973000-63a5-464c-835a-f93ec03e1d1c None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:11:53.739097 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab973000-63a5-464c-835a-f93ec03e1d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:11:53.740107 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-e532900b-7f0d-47c0-9274-07521f11a04d None None] MFA Rules not processed for user `d90cec9e3ff64b5aa4cc867895b996ad`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:11:53.742573 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-e532900b-7f0d-47c0-9274-07521f11a04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:11:53.755114 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 608/1206] 10.222.0.70 () {58 vars in 1059 bytes} [Fri Aug 19 16:11:53 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:11:53.762110 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198a5fb-4bfe-4e41-8507-3114ced222f6 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:11:53.762462 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198a5fb-4bfe-4e41-8507-3114ced222f6 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:11:53.762975 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198a5fb-4bfe-4e41-8507-3114ced222f6 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:11:53.765304 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 609/1207] 10.222.0.70 () {54 vars in 912 bytes} [Fri Aug 19 16:11:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 16:11:53.770886 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-ab973000-63a5-464c-835a-f93ec03e1d1c None None] MFA Rules not processed for user `580372230aad44269e3e0a7b230533f2`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:11:53.771088 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50381ebc-8704-4a9c-84cc-410b3eb01cbe None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:11:53.771430 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50381ebc-8704-4a9c-84cc-410b3eb01cbe None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:11:53.771765 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50381ebc-8704-4a9c-84cc-410b3eb01cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:11:53.772112 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-ab973000-63a5-464c-835a-f93ec03e1d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:11:53.797732 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-50381ebc-8704-4a9c-84cc-410b3eb01cbe None None] MFA Rules not processed for user `d90cec9e3ff64b5aa4cc867895b996ad`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:11:53.799304 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-50381ebc-8704-4a9c-84cc-410b3eb01cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:11:53.809995 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 610/1208] 10.222.0.70 () {58 vars in 1009 bytes} [Fri Aug 19 16:11:53 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:11:53.822147 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50381ebc-8704-4a9c-84cc-410b3eb01cbe None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:11:53.833581 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50381ebc-8704-4a9c-84cc-410b3eb01cbe None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:11:53.841377 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f1cf7-3799-4d07-a18d-d1d208409525 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5593ee9d30b4b65a215a4fe8dfba060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:11:53.842066 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f1cf7-3799-4d07-a18d-d1d208409525 service neutron] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:11:53.842256 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f1cf7-3799-4d07-a18d-d1d208409525 service neutron] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:11:53.842697 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f1cf7-3799-4d07-a18d-d1d208409525 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:11:53.860816 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f1cf7-3799-4d07-a18d-d1d208409525 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:11:53.862512 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f1cf7-3799-4d07-a18d-d1d208409525 service neutron] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:11:53.863401 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 599/1209] 10.222.0.70 () {58 vars in 1058 bytes} [Fri Aug 19 16:11:53 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:11:53.871872 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab973000-63a5-464c-835a-f93ec03e1d1c None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:11:53.881473 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab973000-63a5-464c-835a-f93ec03e1d1c None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:11:53.881902 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 611/1210] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:11:53 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 16:11:53.889396 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f10022b-6ff6-4ed0-904d-66e94a00c11f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580372230aad44269e3e0a7b230533f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:11:53.890018 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f10022b-6ff6-4ed0-904d-66e94a00c11f service placement] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:11:53.890298 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f10022b-6ff6-4ed0-904d-66e94a00c11f service placement] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:11:53.890593 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f10022b-6ff6-4ed0-904d-66e94a00c11f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:11:53.892418 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-6f10022b-6ff6-4ed0-904d-66e94a00c11f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:11:53.907175 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f10022b-6ff6-4ed0-904d-66e94a00c11f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:11:53.908809 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f10022b-6ff6-4ed0-904d-66e94a00c11f service placement] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:11:53.920006 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 600/1211] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:11:53 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 16:12:03.871820 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=91 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:12:03.915602 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=44 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:12:06.360314 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d6a16-176e-4623-9cc1-09293fdcb1fa None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:12:06.360776 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d6a16-176e-4623-9cc1-09293fdcb1fa None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:12:06.360884 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d6a16-176e-4623-9cc1-09293fdcb1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:12:06.381654 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-fb5d6a16-176e-4623-9cc1-09293fdcb1fa None None] MFA Rules not processed for user `f5593ee9d30b4b65a215a4fe8dfba060`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:12:06.382859 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-fb5d6a16-176e-4623-9cc1-09293fdcb1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:12:06.392169 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 612/1212] 10.222.0.65 () {58 vars in 1015 bytes} [Fri Aug 19 16:12:06 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:12:06.404455 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f10022b-6ff6-4ed0-904d-66e94a00c11f service placement] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:12:06.413556 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f10022b-6ff6-4ed0-904d-66e94a00c11f service placement] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:12:06.417265 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc9d05-2fe2-4b96-b552-14777e5587f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5593ee9d30b4b65a215a4fe8dfba060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:12:06.417854 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc9d05-2fe2-4b96-b552-14777e5587f6 service neutron] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:12:06.418130 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc9d05-2fe2-4b96-b552-14777e5587f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:12:06.418401 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc9d05-2fe2-4b96-b552-14777e5587f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:12:06.425547 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc9d05-2fe2-4b96-b552-14777e5587f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:12:06.426967 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc9d05-2fe2-4b96-b552-14777e5587f6 service neutron] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:12:06.434815 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 601/1213] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:12:06 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:12:07.367093 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3adb41f-0b0b-4126-863f-5e9c3ff7d768 None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:12:07.368723 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3adb41f-0b0b-4126-863f-5e9c3ff7d768 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:12:07.368723 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3adb41f-0b0b-4126-863f-5e9c3ff7d768 None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:12:07.369782 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 613/1214] 10.222.0.70 () {54 vars in 921 bytes} [Fri Aug 19 16:12:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:12:07.389041 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c2e38-77b6-4ff7-bfd4-b6e34dfd52b8 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:12:07.389363 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c2e38-77b6-4ff7-bfd4-b6e34dfd52b8 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:12:07.389592 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c2e38-77b6-4ff7-bfd4-b6e34dfd52b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:12:07.410437 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-416c2e38-77b6-4ff7-bfd4-b6e34dfd52b8 None None] MFA Rules not processed for user `d90cec9e3ff64b5aa4cc867895b996ad`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:12:07.410975 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-416c2e38-77b6-4ff7-bfd4-b6e34dfd52b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:12:07.421534 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 602/1215] 10.222.0.70 () {58 vars in 1018 bytes} [Fri Aug 19 16:12:07 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:12:07.460711 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3adb41f-0b0b-4126-863f-5e9c3ff7d768 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:12:07.489647 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3adb41f-0b0b-4126-863f-5e9c3ff7d768 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:12:07.496425 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5593b460-e608-4b02-be6f-a8478e9faeeb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd90cec9e3ff64b5aa4cc867895b996ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:12:07.497192 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593b460-e608-4b02-be6f-a8478e9faeeb service nova] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:12:07.497473 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593b460-e608-4b02-be6f-a8478e9faeeb service nova] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:12:07.497745 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593b460-e608-4b02-be6f-a8478e9faeeb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:12:07.514662 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5593b460-e608-4b02-be6f-a8478e9faeeb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:12:07.516401 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5593b460-e608-4b02-be6f-a8478e9faeeb service nova] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:12:07.527826 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 614/1216] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:12:07 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:12:14.711916 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02946a5e-9909-47f0-a900-88d36d68ef05 None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:12:14.712511 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02946a5e-9909-47f0-a900-88d36d68ef05 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:12:14.713270 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02946a5e-9909-47f0-a900-88d36d68ef05 None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:12:14.714589 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 603/1217] 10.222.0.70 () {54 vars in 921 bytes} [Fri Aug 19 16:12:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:12:14.727673 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b255b-48df-4399-b792-ad51d52a4d28 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:12:14.728206 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b255b-48df-4399-b792-ad51d52a4d28 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:12:14.728206 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b255b-48df-4399-b792-ad51d52a4d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:12:14.748227 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-eb5b255b-48df-4399-b792-ad51d52a4d28 None None] MFA Rules not processed for user `d90cec9e3ff64b5aa4cc867895b996ad`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:12:14.749463 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-eb5b255b-48df-4399-b792-ad51d52a4d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:12:14.758728 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 615/1218] 10.222.0.70 () {58 vars in 1018 bytes} [Fri Aug 19 16:12:14 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:12:14.772307 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02946a5e-9909-47f0-a900-88d36d68ef05 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:12:14.802328 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02946a5e-9909-47f0-a900-88d36d68ef05 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:12:14.810278 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068395a-c9f7-4c56-9762-e681117922aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd90cec9e3ff64b5aa4cc867895b996ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:12:14.810899 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068395a-c9f7-4c56-9762-e681117922aa service nova] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:12:14.811175 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068395a-c9f7-4c56-9762-e681117922aa service nova] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:12:14.811452 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068395a-c9f7-4c56-9762-e681117922aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:12:14.823646 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a068395a-c9f7-4c56-9762-e681117922aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:12:14.825422 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a068395a-c9f7-4c56-9762-e681117922aa service nova] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:12:14.838917 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 604/1219] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:12:14 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 16:12:24.743101 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=12 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:12:24.833238 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=15 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:12:32.149304 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b255b-48df-4399-b792-ad51d52a4d28 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:12:32.164901 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b255b-48df-4399-b792-ad51d52a4d28 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:12:32.170830 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720e8bd-3f01-4448-8320-6a137e89609b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5593ee9d30b4b65a215a4fe8dfba060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:12:32.171783 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720e8bd-3f01-4448-8320-6a137e89609b service neutron] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:12:32.172274 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720e8bd-3f01-4448-8320-6a137e89609b service neutron] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:12:32.172779 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720e8bd-3f01-4448-8320-6a137e89609b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:12:32.187578 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b720e8bd-3f01-4448-8320-6a137e89609b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:12:32.190186 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b720e8bd-3f01-4448-8320-6a137e89609b service neutron] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:12:32.207710 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 616/1220] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:12:32 2022] GET /identity/v3/auth/tokens => generated 2889 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:12:42.199991 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=6 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:14:00.252914 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81425c22-5a23-451a-a2a4-0f7dbe87a2a2 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:14:00.253453 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81425c22-5a23-451a-a2a4-0f7dbe87a2a2 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:14:00.253453 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81425c22-5a23-451a-a2a4-0f7dbe87a2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:14:00.284536 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-81425c22-5a23-451a-a2a4-0f7dbe87a2a2 None None] MFA Rules not processed for user `cfb40baf633d4930a372f464c701bd8f`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:14:00.295401 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-81425c22-5a23-451a-a2a4-0f7dbe87a2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:14:00.315814 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 605/1221] 10.222.0.70 () {58 vars in 958 bytes} [Fri Aug 19 16:14:00 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:14:00.772188 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4531c-de32-4469-8ffb-fb00b9331280 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:14:00.772713 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4531c-de32-4469-8ffb-fb00b9331280 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:14:00.772713 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4531c-de32-4469-8ffb-fb00b9331280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:14:00.842002 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-bcd4531c-de32-4469-8ffb-fb00b9331280 None None] MFA Rules not processed for user `f5593ee9d30b4b65a215a4fe8dfba060`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:14:00.843227 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-bcd4531c-de32-4469-8ffb-fb00b9331280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:14:00.876033 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 617/1222] 10.222.0.70 () {58 vars in 1009 bytes} [Fri Aug 19 16:14:00 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:14:00.888432 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81425c22-5a23-451a-a2a4-0f7dbe87a2a2 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:14:00.898332 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81425c22-5a23-451a-a2a4-0f7dbe87a2a2 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:14:00.902289 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd36581-fbbc-4f13-975b-c009172258b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5593ee9d30b4b65a215a4fe8dfba060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:14:00.902889 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd36581-fbbc-4f13-975b-c009172258b5 service neutron] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:14:00.903164 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd36581-fbbc-4f13-975b-c009172258b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:14:00.903433 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd36581-fbbc-4f13-975b-c009172258b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:14:00.910980 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd36581-fbbc-4f13-975b-c009172258b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:14:00.912401 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd36581-fbbc-4f13-975b-c009172258b5 service neutron] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:14:00.920162 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 606/1223] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:14:00 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:14:10.873401 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=33 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:14:10.916868 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=21 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:14:45.344303 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11142ddb-d543-4b04-9747-571c6ea3ef3d None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:14:45.344899 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11142ddb-d543-4b04-9747-571c6ea3ef3d None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:14:45.345237 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11142ddb-d543-4b04-9747-571c6ea3ef3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:14:45.369973 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-11142ddb-d543-4b04-9747-571c6ea3ef3d None None] MFA Rules not processed for user `cfb40baf633d4930a372f464c701bd8f`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:14:45.371185 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-11142ddb-d543-4b04-9747-571c6ea3ef3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:14:45.378455 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 618/1224] 10.222.0.70 () {58 vars in 958 bytes} [Fri Aug 19 16:14:45 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:14:51.674350 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd36581-fbbc-4f13-975b-c009172258b5 service neutron] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:14:51.714137 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd36581-fbbc-4f13-975b-c009172258b5 service neutron] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:14:51.721338 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3eff48-3fc6-4e8d-af0a-71303c6c0779 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580372230aad44269e3e0a7b230533f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:14:51.721957 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3eff48-3fc6-4e8d-af0a-71303c6c0779 service placement] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:14:51.722232 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3eff48-3fc6-4e8d-af0a-71303c6c0779 service placement] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:14:51.722519 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3eff48-3fc6-4e8d-af0a-71303c6c0779 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:14:51.735547 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3eff48-3fc6-4e8d-af0a-71303c6c0779 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:14:51.737066 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3eff48-3fc6-4e8d-af0a-71303c6c0779 service placement] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:14:51.749873 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 607/1225] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:14:51 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 16:14:55.363591 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=3 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:15:01.744450 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=13 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:15:06.346123 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04334c21-0e89-4ffc-8e73-c35f8b4b03e9 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:15:06.346671 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04334c21-0e89-4ffc-8e73-c35f8b4b03e9 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:15:06.346766 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04334c21-0e89-4ffc-8e73-c35f8b4b03e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:15:06.365967 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-04334c21-0e89-4ffc-8e73-c35f8b4b03e9 None None] MFA Rules not processed for user `cfb40baf633d4930a372f464c701bd8f`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:15:06.367225 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-04334c21-0e89-4ffc-8e73-c35f8b4b03e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:15:06.374105 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 619/1226] 10.222.0.70 () {58 vars in 958 bytes} [Fri Aug 19 16:15:06 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:15:16.360570 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=3 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:16:04.908363 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81fc95b-b666-4389-9994-1fdf1868f4ea None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:04.927244 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81fc95b-b666-4389-9994-1fdf1868f4ea None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:04.927244 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81fc95b-b666-4389-9994-1fdf1868f4ea None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:04.927244 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 608/1227] 10.222.0.70 () {54 vars in 921 bytes} [Fri Aug 19 16:16:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:16:04.927867 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f357c01-30a1-4cfd-a046-a3b1c5042188 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:04.927867 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f357c01-30a1-4cfd-a046-a3b1c5042188 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:04.927867 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f357c01-30a1-4cfd-a046-a3b1c5042188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:04.974037 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-1f357c01-30a1-4cfd-a046-a3b1c5042188 None None] MFA Rules not processed for user `d90cec9e3ff64b5aa4cc867895b996ad`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:16:04.975015 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-1f357c01-30a1-4cfd-a046-a3b1c5042188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:16:04.996514 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 620/1228] 10.222.0.70 () {58 vars in 1018 bytes} [Fri Aug 19 16:16:04 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 16:16:05.013035 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81fc95b-b666-4389-9994-1fdf1868f4ea None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:16:05.030384 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81fc95b-b666-4389-9994-1fdf1868f4ea None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:16:05.036907 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818fc4cb-f827-48c4-8798-bb027f378c3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd90cec9e3ff64b5aa4cc867895b996ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:16:05.037534 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818fc4cb-f827-48c4-8798-bb027f378c3f service nova] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:05.037815 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818fc4cb-f827-48c4-8798-bb027f378c3f service nova] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:05.038141 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818fc4cb-f827-48c4-8798-bb027f378c3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:05.049949 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818fc4cb-f827-48c4-8798-bb027f378c3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:16:05.051661 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818fc4cb-f827-48c4-8798-bb027f378c3f service nova] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:16:05.063872 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 609/1229] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:16:05 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:16:14.992759 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=18 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:16:15.059369 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=6 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:16:30.075684 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5661d5b-0053-4feb-8794-c36638dc4ad7 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:30.080302 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5661d5b-0053-4feb-8794-c36638dc4ad7 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:30.080302 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5661d5b-0053-4feb-8794-c36638dc4ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:30.094649 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-b5661d5b-0053-4feb-8794-c36638dc4ad7 None None] MFA Rules not processed for user `0be6f81a458345a899f185c255d79df9`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:16:30.095857 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-b5661d5b-0053-4feb-8794-c36638dc4ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:16:30.103317 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 621/1230] 10.222.0.70 () {58 vars in 958 bytes} [Fri Aug 19 16:16:30 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:16:35.631090 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d8b4f-28fc-4a9a-b3eb-ade64e9e7c38 None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:35.631641 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d8b4f-28fc-4a9a-b3eb-ade64e9e7c38 None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:35.632134 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d8b4f-28fc-4a9a-b3eb-ade64e9e7c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:35.653410 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-940d8b4f-28fc-4a9a-b3eb-ade64e9e7c38 None None] MFA Rules not processed for user `cfb40baf633d4930a372f464c701bd8f`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:16:35.654622 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-940d8b4f-28fc-4a9a-b3eb-ade64e9e7c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:16:35.662014 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 610/1231] 10.222.0.70 () {58 vars in 958 bytes} [Fri Aug 19 16:16:35 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:16:40.089490 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=3 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:16:42.444050 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5661d5b-0053-4feb-8794-c36638dc4ad7 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:16:42.455957 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5661d5b-0053-4feb-8794-c36638dc4ad7 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:16:42.462346 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09044308-fbb6-4349-8f6e-2a4edef6523a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd90cec9e3ff64b5aa4cc867895b996ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:16:42.462969 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09044308-fbb6-4349-8f6e-2a4edef6523a service nova] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:42.463241 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09044308-fbb6-4349-8f6e-2a4edef6523a service nova] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:42.463503 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09044308-fbb6-4349-8f6e-2a4edef6523a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:42.471723 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09044308-fbb6-4349-8f6e-2a4edef6523a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:16:42.473342 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09044308-fbb6-4349-8f6e-2a4edef6523a service nova] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:16:42.495215 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 622/1232] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:16:42 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:16:43.159799 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d8b4f-28fc-4a9a-b3eb-ade64e9e7c38 None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:16:43.170176 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d8b4f-28fc-4a9a-b3eb-ade64e9e7c38 None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:16:43.173935 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e92440-9bbe-4b18-9f46-0e71cc83f8a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5593ee9d30b4b65a215a4fe8dfba060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:16:43.174605 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e92440-9bbe-4b18-9f46-0e71cc83f8a5 service neutron] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:43.174917 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e92440-9bbe-4b18-9f46-0e71cc83f8a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:43.175194 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e92440-9bbe-4b18-9f46-0e71cc83f8a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:43.185157 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e92440-9bbe-4b18-9f46-0e71cc83f8a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:16:43.186723 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e92440-9bbe-4b18-9f46-0e71cc83f8a5 service neutron] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:16:43.198771 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 611/1233] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:16:43 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:16:52.431528 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09044308-fbb6-4349-8f6e-2a4edef6523a service nova] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:16:52.441370 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09044308-fbb6-4349-8f6e-2a4edef6523a service nova] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:16:52.445594 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90833cf1-89ba-481d-af16-7b7eb252b9d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5593ee9d30b4b65a215a4fe8dfba060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:16:52.446600 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90833cf1-89ba-481d-af16-7b7eb252b9d4 service neutron] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:52.447027 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90833cf1-89ba-481d-af16-7b7eb252b9d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:52.447426 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90833cf1-89ba-481d-af16-7b7eb252b9d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:52.457971 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90833cf1-89ba-481d-af16-7b7eb252b9d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:16:52.459459 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90833cf1-89ba-481d-af16-7b7eb252b9d4 service neutron] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:16:52.470984 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 623/1234] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:16:52 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:16:53.192946 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=9 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:16:56.066601 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e92440-9bbe-4b18-9f46-0e71cc83f8a5 service neutron] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:16:56.076064 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e92440-9bbe-4b18-9f46-0e71cc83f8a5 service neutron] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:16:56.080108 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7151a1a-34d1-438d-8214-6caadfb4575e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5593ee9d30b4b65a215a4fe8dfba060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:16:56.081808 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7151a1a-34d1-438d-8214-6caadfb4575e service neutron] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:56.082278 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7151a1a-34d1-438d-8214-6caadfb4575e service neutron] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:56.082737 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7151a1a-34d1-438d-8214-6caadfb4575e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:56.096139 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7151a1a-34d1-438d-8214-6caadfb4575e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:16:56.097629 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7151a1a-34d1-438d-8214-6caadfb4575e service neutron] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:16:56.110033 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 612/1235] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:16:56 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:16:57.617261 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90833cf1-89ba-481d-af16-7b7eb252b9d4 service neutron] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:16:57.626753 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90833cf1-89ba-481d-af16-7b7eb252b9d4 service neutron] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:16:57.630535 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b706d-5f4b-40be-a486-43b850effa59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5593ee9d30b4b65a215a4fe8dfba060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:16:57.631217 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b706d-5f4b-40be-a486-43b850effa59 service neutron] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:16:57.631537 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b706d-5f4b-40be-a486-43b850effa59 service neutron] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:16:57.631869 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b706d-5f4b-40be-a486-43b850effa59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:16:57.641336 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5b706d-5f4b-40be-a486-43b850effa59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:16:57.642925 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5b706d-5f4b-40be-a486-43b850effa59 service neutron] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:16:57.652579 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 624/1236] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:16:57 2022] GET /identity/v3/auth/tokens => generated 2879 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:17:06.105277 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=6 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:07.154295 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7151a1a-34d1-438d-8214-6caadfb4575e service neutron] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:07.165526 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7151a1a-34d1-438d-8214-6caadfb4575e service neutron] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:07.171269 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f440208c-3ad5-471a-8021-728260ca0c75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd90cec9e3ff64b5aa4cc867895b996ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:07.171919 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440208c-3ad5-471a-8021-728260ca0c75 service nova] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:07.172216 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440208c-3ad5-471a-8021-728260ca0c75 service nova] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:07.172694 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440208c-3ad5-471a-8021-728260ca0c75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:07.184692 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f440208c-3ad5-471a-8021-728260ca0c75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:07.189001 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f440208c-3ad5-471a-8021-728260ca0c75 service nova] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:07.200070 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 613/1237] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:17:07 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:17:07.285536 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b706d-5f4b-40be-a486-43b850effa59 service neutron] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:17:07.297185 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b706d-5f4b-40be-a486-43b850effa59 service neutron] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:17:07.301800 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a8f13a-e5d7-4733-b99f-ed7d0945241a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5593ee9d30b4b65a215a4fe8dfba060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:17:07.302768 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8f13a-e5d7-4733-b99f-ed7d0945241a service neutron] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:17:07.303204 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8f13a-e5d7-4733-b99f-ed7d0945241a service neutron] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:17:07.303620 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8f13a-e5d7-4733-b99f-ed7d0945241a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:17:07.313729 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a8f13a-e5d7-4733-b99f-ed7d0945241a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:17:07.315703 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a8f13a-e5d7-4733-b99f-ed7d0945241a service neutron] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:17:07.327357 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 625/1238] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:17:07 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:17:17.193738 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=6 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:17:17.322620 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=24 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:38.496748 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f440208c-3ad5-471a-8021-728260ca0c75 service nova] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:38.506575 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f440208c-3ad5-471a-8021-728260ca0c75 service nova] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:38.511039 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5facc456-5f2d-4f71-92c2-6cd55f824f69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5593ee9d30b4b65a215a4fe8dfba060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:38.513587 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facc456-5f2d-4f71-92c2-6cd55f824f69 service neutron] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:38.514200 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facc456-5f2d-4f71-92c2-6cd55f824f69 service neutron] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:38.514614 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facc456-5f2d-4f71-92c2-6cd55f824f69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:38.604683 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5facc456-5f2d-4f71-92c2-6cd55f824f69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:38.606424 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5facc456-5f2d-4f71-92c2-6cd55f824f69 service neutron] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:38.626294 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 614/1239] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:18:38 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:18:42.632073 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f58933-5e62-486f-8b74-25552016bbbf None None] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:42.637734 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f58933-5e62-486f-8b74-25552016bbbf None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:42.637734 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f58933-5e62-486f-8b74-25552016bbbf None None] PATH_INFO: `/` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:42.637734 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 626/1240] 10.222.0.70 () {54 vars in 921 bytes} [Fri Aug 19 16:18:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:18:42.870165 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16915b3-8262-443c-abd0-10a667ee536e None None] REQUEST_METHOD: `POST` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:42.870686 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16915b3-8262-443c-abd0-10a667ee536e None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:42.870686 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16915b3-8262-443c-abd0-10a667ee536e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:42.914389 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.auth.core [None req-f16915b3-8262-443c-abd0-10a667ee536e None None] MFA Rules not processed for user `580372230aad44269e3e0a7b230533f2`. Rule list: `[]` (Enabled: `True`). {{(pid=88367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:18:42.915602 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-f16915b3-8262-443c-abd0-10a667ee536e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:42.926925 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 615/1241] 10.222.0.70 () {58 vars in 1018 bytes} [Fri Aug 19 16:18:42 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:18:42.938958 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f58933-5e62-486f-8b74-25552016bbbf None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:42.953257 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f58933-5e62-486f-8b74-25552016bbbf None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:42.958278 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d27500d-36a8-4f95-8d17-1b943aac9379 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580372230aad44269e3e0a7b230533f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:42.958900 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d27500d-36a8-4f95-8d17-1b943aac9379 service placement] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:42.959167 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d27500d-36a8-4f95-8d17-1b943aac9379 service placement] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:42.959455 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d27500d-36a8-4f95-8d17-1b943aac9379 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:42.969030 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d27500d-36a8-4f95-8d17-1b943aac9379 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:42.970594 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d27500d-36a8-4f95-8d17-1b943aac9379 service placement] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:42.981026 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 627/1242] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:18:42 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:18:47.166888 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c6fc6-646a-4967-b2db-767cd6848d4f None None] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:47.167444 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c6fc6-646a-4967-b2db-767cd6848d4f None None] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:47.167444 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c6fc6-646a-4967-b2db-767cd6848d4f None None] PATH_INFO: `/` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:47.168981 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 616/1243] 10.222.0.70 () {54 vars in 921 bytes} [Fri Aug 19 16:18:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 16:18:47.201952 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c80dd4-e46c-46eb-99e0-92b575b19239 None None] REQUEST_METHOD: `POST` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:47.202753 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c80dd4-e46c-46eb-99e0-92b575b19239 None None] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:47.202753 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c80dd4-e46c-46eb-99e0-92b575b19239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:47.223214 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.auth.core [None req-67c80dd4-e46c-46eb-99e0-92b575b19239 None None] MFA Rules not processed for user `580372230aad44269e3e0a7b230533f2`. Rule list: `[]` (Enabled: `True`). {{(pid=88368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 16:18:47.224558 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-67c80dd4-e46c-46eb-99e0-92b575b19239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:47.245169 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 628/1244] 10.222.0.70 () {58 vars in 1018 bytes} [Fri Aug 19 16:18:47 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 16:18:47.257220 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5c6fc6-646a-4967-b2db-767cd6848d4f None None] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:47.271246 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5c6fc6-646a-4967-b2db-767cd6848d4f None None] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:47.276328 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17672ad6-90bc-404c-8d53-fb667ee247f7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580372230aad44269e3e0a7b230533f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:47.276978 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17672ad6-90bc-404c-8d53-fb667ee247f7 service placement] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:47.277258 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17672ad6-90bc-404c-8d53-fb667ee247f7 service placement] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:47.278192 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17672ad6-90bc-404c-8d53-fb667ee247f7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:47.286951 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17672ad6-90bc-404c-8d53-fb667ee247f7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:47.289098 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17672ad6-90bc-404c-8d53-fb667ee247f7 service placement] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:47.303351 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 617/1245] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:18:47 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:18:47.358502 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c80dd4-e46c-46eb-99e0-92b575b19239 None None] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:47.372562 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c80dd4-e46c-46eb-99e0-92b575b19239 None None] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:47.380546 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701900fb-6454-4483-b7cf-cf779411580d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e72646e5274546c7b7216d7348ce3bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:47.380546 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701900fb-6454-4483-b7cf-cf779411580d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:47.380546 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701900fb-6454-4483-b7cf-cf779411580d admin admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:47.380546 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701900fb-6454-4483-b7cf-cf779411580d admin admin] PATH_INFO: `/v3/users/0be6f81a458345a899f185c255d79df9` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:47.380979 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701900fb-6454-4483-b7cf-cf779411580d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0be6f81a458345a899f185c255d79df9)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:47.381906 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701900fb-6454-4483-b7cf-cf779411580d admin admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:47.665367 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.notifications [None req-701900fb-6454-4483-b7cf-cf779411580d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0be6f81a458345a899f185c255d79df9'} {{(pid=88368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:18:47.672990 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.notifications [None req-701900fb-6454-4483-b7cf-cf779411580d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0be6f81a458345a899f185c255d79df9'} {{(pid=88368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:18:47.684949 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.notifications [None req-701900fb-6454-4483-b7cf-cf779411580d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0be6f81a458345a899f185c255d79df9'} {{(pid=88368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:18:47.795174 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.notifications [None req-701900fb-6454-4483-b7cf-cf779411580d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0be6f81a458345a899f185c255d79df9'} {{(pid=88368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:18:47.795809 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.notifications [None req-701900fb-6454-4483-b7cf-cf779411580d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0be6f81a458345a899f185c255d79df9'} {{(pid=88368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:18:47.802374 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 629/1246] 10.222.0.70 () {58 vars in 1224 bytes} [Fri Aug 19 16:18:47 2022] DELETE /identity/v3/users/0be6f81a458345a899f185c255d79df9 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:18:48.059787 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17672ad6-90bc-404c-8d53-fb667ee247f7 service placement] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:48.071435 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17672ad6-90bc-404c-8d53-fb667ee247f7 service placement] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:48.141776 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb61292-6fa9-4aa4-8926-0510efa16cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e72646e5274546c7b7216d7348ce3bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:48.149345 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb61292-6fa9-4aa4-8926-0510efa16cdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:48.149345 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb61292-6fa9-4aa4-8926-0510efa16cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:48.149345 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb61292-6fa9-4aa4-8926-0510efa16cdc admin admin] PATH_INFO: `/v3/projects/84ca50dda4c040808c2fcd82fc0358d6` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:48.149345 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb61292-6fa9-4aa4-8926-0510efa16cdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=84ca50dda4c040808c2fcd82fc0358d6)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:48.149345 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb61292-6fa9-4aa4-8926-0510efa16cdc admin admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:48.348635 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:48.351452 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.notifications [None req-ddb61292-6fa9-4aa4-8926-0510efa16cdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84ca50dda4c040808c2fcd82fc0358d6', 'request_id': 'req-ddb61292-6fa9-4aa4-8926-0510efa16cdc'} {{(pid=88367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:18:48.358119 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.notifications [None req-ddb61292-6fa9-4aa4-8926-0510efa16cdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84ca50dda4c040808c2fcd82fc0358d6', 'request_id': 'req-ddb61292-6fa9-4aa4-8926-0510efa16cdc'} {{(pid=88367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:18:48.472019 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.notifications [None req-ddb61292-6fa9-4aa4-8926-0510efa16cdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84ca50dda4c040808c2fcd82fc0358d6', 'request_id': 'req-ddb61292-6fa9-4aa4-8926-0510efa16cdc'} {{(pid=88367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:18:48.500390 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.notifications [None req-ddb61292-6fa9-4aa4-8926-0510efa16cdc admin admin] The token cache is being invalidate because project 84ca50dda4c040808c2fcd82fc0358d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:18:48.500715 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.notifications [None req-ddb61292-6fa9-4aa4-8926-0510efa16cdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:18:48.501420 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.notifications [None req-ddb61292-6fa9-4aa4-8926-0510efa16cdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:18:48.502968 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 618/1247] 10.222.0.70 () {58 vars in 1233 bytes} [Fri Aug 19 16:18:48 2022] DELETE /identity/v3/projects/84ca50dda4c040808c2fcd82fc0358d6 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:18:48.507300 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701900fb-6454-4483-b7cf-cf779411580d admin admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:48.508876 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-701900fb-6454-4483-b7cf-cf779411580d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:48.522721 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701900fb-6454-4483-b7cf-cf779411580d admin admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:48.582754 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c16d90f-b9b1-4479-a441-af3ce705a25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e72646e5274546c7b7216d7348ce3bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:48.583386 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16d90f-b9b1-4479-a441-af3ce705a25e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:48.583659 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16d90f-b9b1-4479-a441-af3ce705a25e admin admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:48.583928 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16d90f-b9b1-4479-a441-af3ce705a25e admin admin] PATH_INFO: `/v3/users/19bfeb8ccdc84f41ba2ca50d644af79a` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:48.585102 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c16d90f-b9b1-4479-a441-af3ce705a25e admin admin] RBAC: Authorizing `identity:delete_user(user_id=19bfeb8ccdc84f41ba2ca50d644af79a)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:48.587057 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c16d90f-b9b1-4479-a441-af3ce705a25e admin admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:48.920342 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.notifications [None req-8c16d90f-b9b1-4479-a441-af3ce705a25e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19bfeb8ccdc84f41ba2ca50d644af79a'} {{(pid=88368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:18:48.926799 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:48.929392 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.notifications [None req-8c16d90f-b9b1-4479-a441-af3ce705a25e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19bfeb8ccdc84f41ba2ca50d644af79a'} {{(pid=88368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:18:48.944928 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.notifications [None req-8c16d90f-b9b1-4479-a441-af3ce705a25e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19bfeb8ccdc84f41ba2ca50d644af79a'} {{(pid=88368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:18:49.140570 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.notifications [None req-8c16d90f-b9b1-4479-a441-af3ce705a25e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19bfeb8ccdc84f41ba2ca50d644af79a'} {{(pid=88368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:18:49.141381 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.notifications [None req-8c16d90f-b9b1-4479-a441-af3ce705a25e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19bfeb8ccdc84f41ba2ca50d644af79a'} {{(pid=88368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:18:49.147847 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 630/1248] 10.222.0.70 () {58 vars in 1224 bytes} [Fri Aug 19 16:18:48 2022] DELETE /identity/v3/users/19bfeb8ccdc84f41ba2ca50d644af79a => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:18:49.492877 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb61292-6fa9-4aa4-8926-0510efa16cdc admin admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:18:49.492877 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-ddb61292-6fa9-4aa4-8926-0510efa16cdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:18:49.507097 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb61292-6fa9-4aa4-8926-0510efa16cdc admin admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:18:49.567483 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95f7a0-d202-4c8c-9e64-717b47a7c307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e72646e5274546c7b7216d7348ce3bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:18:49.568104 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95f7a0-d202-4c8c-9e64-717b47a7c307 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:18:49.568385 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95f7a0-d202-4c8c-9e64-717b47a7c307 admin admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:18:49.568682 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95f7a0-d202-4c8c-9e64-717b47a7c307 admin admin] PATH_INFO: `/v3/projects/dcb65b6a4715460cbb428704328995d0` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:18:49.569828 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb95f7a0-d202-4c8c-9e64-717b47a7c307 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcb65b6a4715460cbb428704328995d0)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:18:49.571783 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb95f7a0-d202-4c8c-9e64-717b47a7c307 admin admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:18:49.694214 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.notifications [None req-bb95f7a0-d202-4c8c-9e64-717b47a7c307 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcb65b6a4715460cbb428704328995d0', 'request_id': 'req-bb95f7a0-d202-4c8c-9e64-717b47a7c307'} {{(pid=88367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:18:49.700381 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.notifications [None req-bb95f7a0-d202-4c8c-9e64-717b47a7c307 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcb65b6a4715460cbb428704328995d0', 'request_id': 'req-bb95f7a0-d202-4c8c-9e64-717b47a7c307'} {{(pid=88367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:18:49.788872 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.notifications [None req-bb95f7a0-d202-4c8c-9e64-717b47a7c307 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcb65b6a4715460cbb428704328995d0', 'request_id': 'req-bb95f7a0-d202-4c8c-9e64-717b47a7c307'} {{(pid=88367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:18:49.800914 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.notifications [None req-bb95f7a0-d202-4c8c-9e64-717b47a7c307 admin admin] The token cache is being invalidate because project dcb65b6a4715460cbb428704328995d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:18:49.806128 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.notifications [None req-bb95f7a0-d202-4c8c-9e64-717b47a7c307 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:18:49.806128 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.notifications [None req-bb95f7a0-d202-4c8c-9e64-717b47a7c307 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:18:49.806128 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 619/1249] 10.222.0.70 () {58 vars in 1233 bytes} [Fri Aug 19 16:18:49 2022] DELETE /identity/v3/projects/dcb65b6a4715460cbb428704328995d0 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:18:59.322996 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=9,keystone:DELETE=3,keystone:INSERT=1 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:18:59.797714 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:DELETE=11,keystone:SELECT=63,keystone:INSERT=2 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:19:57.008239 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c16d90f-b9b1-4479-a441-af3ce705a25e admin admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:19:57.010312 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-8c16d90f-b9b1-4479-a441-af3ce705a25e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:19:57.091831 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c16d90f-b9b1-4479-a441-af3ce705a25e admin admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:19:57.151707 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb2dc5-5bec-4d32-a718-ee62cc71415b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580372230aad44269e3e0a7b230533f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:19:57.152322 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb2dc5-5bec-4d32-a718-ee62cc71415b service placement] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:19:57.152679 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb2dc5-5bec-4d32-a718-ee62cc71415b service placement] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:19:57.152968 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb2dc5-5bec-4d32-a718-ee62cc71415b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:19:57.154734 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-5aeb2dc5-5bec-4d32-a718-ee62cc71415b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:19:57.167268 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeb2dc5-5bec-4d32-a718-ee62cc71415b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:19:57.169007 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeb2dc5-5bec-4d32-a718-ee62cc71415b service placement] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:19:57.178847 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 631/1250] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:19:57 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:20:07.174864 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=63 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:20:33.565331 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95f7a0-d202-4c8c-9e64-717b47a7c307 admin admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:20:33.566845 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-bb95f7a0-d202-4c8c-9e64-717b47a7c307 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:20:33.625135 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95f7a0-d202-4c8c-9e64-717b47a7c307 admin admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:20:33.628726 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ee51e-188d-450f-947c-38d6b9e8ce3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5593ee9d30b4b65a215a4fe8dfba060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:20:33.629323 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ee51e-188d-450f-947c-38d6b9e8ce3f service neutron] REQUEST_METHOD: `GET` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:20:33.629596 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ee51e-188d-450f-947c-38d6b9e8ce3f service neutron] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:20:33.629863 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ee51e-188d-450f-947c-38d6b9e8ce3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:20:33.631575 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-1c4ee51e-188d-450f-947c-38d6b9e8ce3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:20:33.694903 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4ee51e-188d-450f-947c-38d6b9e8ce3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:20:33.696332 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4ee51e-188d-450f-947c-38d6b9e8ce3f service neutron] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:20:33.706079 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 620/1251] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:20:33 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 16:20:41.628189 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb2dc5-5bec-4d32-a718-ee62cc71415b service placement] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:20:41.629860 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-5aeb2dc5-5bec-4d32-a718-ee62cc71415b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:20:41.646366 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb2dc5-5bec-4d32-a718-ee62cc71415b service placement] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:20:41.651042 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ef92d-e6d6-40cb-839c-a1cbb6beb095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e72646e5274546c7b7216d7348ce3bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:20:41.651722 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ef92d-e6d6-40cb-839c-a1cbb6beb095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:20:41.652003 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ef92d-e6d6-40cb-839c-a1cbb6beb095 admin admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:20:41.652276 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ef92d-e6d6-40cb-839c-a1cbb6beb095 admin admin] PATH_INFO: `/v3/users/cfb40baf633d4930a372f464c701bd8f` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:20:41.653764 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10ef92d-e6d6-40cb-839c-a1cbb6beb095 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfb40baf633d4930a372f464c701bd8f)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:20:41.655695 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10ef92d-e6d6-40cb-839c-a1cbb6beb095 admin admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:20:41.944881 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.notifications [None req-e10ef92d-e6d6-40cb-839c-a1cbb6beb095 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfb40baf633d4930a372f464c701bd8f'} {{(pid=88368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:20:41.953604 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.notifications [None req-e10ef92d-e6d6-40cb-839c-a1cbb6beb095 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfb40baf633d4930a372f464c701bd8f'} {{(pid=88368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:20:41.966632 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.notifications [None req-e10ef92d-e6d6-40cb-839c-a1cbb6beb095 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfb40baf633d4930a372f464c701bd8f'} {{(pid=88368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:20:42.058975 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.notifications [None req-e10ef92d-e6d6-40cb-839c-a1cbb6beb095 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfb40baf633d4930a372f464c701bd8f'} {{(pid=88368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:20:42.059810 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.notifications [None req-e10ef92d-e6d6-40cb-839c-a1cbb6beb095 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfb40baf633d4930a372f464c701bd8f'} {{(pid=88368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:20:42.066789 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 632/1252] 10.222.0.70 () {58 vars in 1224 bytes} [Fri Aug 19 16:20:41 2022] DELETE /identity/v3/users/cfb40baf633d4930a372f464c701bd8f => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:20:42.340873 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ee51e-188d-450f-947c-38d6b9e8ce3f service neutron] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:20:42.354906 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ee51e-188d-450f-947c-38d6b9e8ce3f service neutron] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:20:42.420292 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9abc349-598b-4339-b163-69dc5cd8bfaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e72646e5274546c7b7216d7348ce3bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:20:42.420969 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9abc349-598b-4339-b163-69dc5cd8bfaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:20:42.421248 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9abc349-598b-4339-b163-69dc5cd8bfaf admin admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:20:42.421526 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9abc349-598b-4339-b163-69dc5cd8bfaf admin admin] PATH_INFO: `/v3/projects/9d34bbc3043c4333b1f57b3d260fbb49` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:20:42.422684 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9abc349-598b-4339-b163-69dc5cd8bfaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d34bbc3043c4333b1f57b3d260fbb49)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:20:42.424632 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9abc349-598b-4339-b163-69dc5cd8bfaf admin admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:20:42.529535 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.notifications [None req-f9abc349-598b-4339-b163-69dc5cd8bfaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d34bbc3043c4333b1f57b3d260fbb49', 'request_id': 'req-f9abc349-598b-4339-b163-69dc5cd8bfaf'} {{(pid=88367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:20:42.531471 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:20:42.535412 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.notifications [None req-f9abc349-598b-4339-b163-69dc5cd8bfaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d34bbc3043c4333b1f57b3d260fbb49', 'request_id': 'req-f9abc349-598b-4339-b163-69dc5cd8bfaf'} {{(pid=88367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:20:42.638419 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.notifications [None req-f9abc349-598b-4339-b163-69dc5cd8bfaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d34bbc3043c4333b1f57b3d260fbb49', 'request_id': 'req-f9abc349-598b-4339-b163-69dc5cd8bfaf'} {{(pid=88367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:20:42.650365 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.notifications [None req-f9abc349-598b-4339-b163-69dc5cd8bfaf admin admin] The token cache is being invalidate because project 9d34bbc3043c4333b1f57b3d260fbb49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:20:42.650686 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.notifications [None req-f9abc349-598b-4339-b163-69dc5cd8bfaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:20:42.651338 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.notifications [None req-f9abc349-598b-4339-b163-69dc5cd8bfaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:20:42.653487 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 621/1253] 10.222.0.70 () {58 vars in 1233 bytes} [Fri Aug 19 16:20:42 2022] DELETE /identity/v3/projects/9d34bbc3043c4333b1f57b3d260fbb49 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:20:42.657553 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ef92d-e6d6-40cb-839c-a1cbb6beb095 admin admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:20:42.658984 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-e10ef92d-e6d6-40cb-839c-a1cbb6beb095 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:20:42.672327 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ef92d-e6d6-40cb-839c-a1cbb6beb095 admin admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:20:42.735568 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23c5ef-b34c-423a-b335-ea0363ed30b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e72646e5274546c7b7216d7348ce3bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:20:42.736266 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23c5ef-b34c-423a-b335-ea0363ed30b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:20:42.736615 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23c5ef-b34c-423a-b335-ea0363ed30b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:20:42.736988 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23c5ef-b34c-423a-b335-ea0363ed30b2 admin admin] PATH_INFO: `/v3/users/175158bac664482d8e784ce250707fe0` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:20:42.738169 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a23c5ef-b34c-423a-b335-ea0363ed30b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=175158bac664482d8e784ce250707fe0)` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:20:42.740185 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a23c5ef-b34c-423a-b335-ea0363ed30b2 admin admin] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:20:42.989614 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.notifications [None req-6a23c5ef-b34c-423a-b335-ea0363ed30b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '175158bac664482d8e784ce250707fe0'} {{(pid=88368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:20:42.996277 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.notifications [None req-6a23c5ef-b34c-423a-b335-ea0363ed30b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '175158bac664482d8e784ce250707fe0'} {{(pid=88368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:20:43.008683 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.notifications [None req-6a23c5ef-b34c-423a-b335-ea0363ed30b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '175158bac664482d8e784ce250707fe0'} {{(pid=88368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:20:43.010323 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:20:43.123172 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.notifications [None req-6a23c5ef-b34c-423a-b335-ea0363ed30b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '175158bac664482d8e784ce250707fe0'} {{(pid=88368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:20:43.123808 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.notifications [None req-6a23c5ef-b34c-423a-b335-ea0363ed30b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '175158bac664482d8e784ce250707fe0'} {{(pid=88368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:20:43.130367 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 633/1254] 10.222.0.70 () {58 vars in 1224 bytes} [Fri Aug 19 16:20:42 2022] DELETE /identity/v3/users/175158bac664482d8e784ce250707fe0 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:20:43.403595 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9abc349-598b-4339-b163-69dc5cd8bfaf admin admin] Authenticating user token {{(pid=88367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:20:43.405237 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.fernet_utils [None req-f9abc349-598b-4339-b163-69dc5cd8bfaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:20:43.419993 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9abc349-598b-4339-b163-69dc5cd8bfaf admin admin] Validating token access rules against request {{(pid=88367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:20:43.482275 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b626d-cd27-47ac-b0a8-5a395b2de176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39fb10cdfa334097bc6eed362d01249d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e72646e5274546c7b7216d7348ce3bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:20:43.482907 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b626d-cd27-47ac-b0a8-5a395b2de176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:20:43.483822 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b626d-cd27-47ac-b0a8-5a395b2de176 admin admin] SCRIPT_NAME: `/identity` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:20:43.484138 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b626d-cd27-47ac-b0a8-5a395b2de176 admin admin] PATH_INFO: `/v3/projects/3d02fde425ed4c78b5ce9592703f8837` {{(pid=88367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:20:43.485296 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724b626d-cd27-47ac-b0a8-5a395b2de176 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d02fde425ed4c78b5ce9592703f8837)` {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:20:43.487205 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724b626d-cd27-47ac-b0a8-5a395b2de176 admin admin] RBAC: Authorization granted {{(pid=88367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:20:43.636744 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.notifications [None req-724b626d-cd27-47ac-b0a8-5a395b2de176 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d02fde425ed4c78b5ce9592703f8837', 'request_id': 'req-724b626d-cd27-47ac-b0a8-5a395b2de176'} {{(pid=88367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:20:43.642752 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.notifications [None req-724b626d-cd27-47ac-b0a8-5a395b2de176 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d02fde425ed4c78b5ce9592703f8837', 'request_id': 'req-724b626d-cd27-47ac-b0a8-5a395b2de176'} {{(pid=88367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:20:43.789835 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.notifications [None req-724b626d-cd27-47ac-b0a8-5a395b2de176 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d02fde425ed4c78b5ce9592703f8837', 'request_id': 'req-724b626d-cd27-47ac-b0a8-5a395b2de176'} {{(pid=88367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:20:43.802241 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.notifications [None req-724b626d-cd27-47ac-b0a8-5a395b2de176 admin admin] The token cache is being invalidate because project 3d02fde425ed4c78b5ce9592703f8837 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 16:20:43.802531 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.notifications [None req-724b626d-cd27-47ac-b0a8-5a395b2de176 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:20:43.803169 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG keystone.notifications [None req-724b626d-cd27-47ac-b0a8-5a395b2de176 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 16:20:43.804684 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: [pid: 88367|app: 0|req: 622/1255] 10.222.0.70 () {58 vars in 1233 bytes} [Fri Aug 19 16:20:43 2022] DELETE /identity/v3/projects/3d02fde425ed4c78b5ce9592703f8837 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 16:20:53.799330 dv-osbrick-849021-5-ceph devstack@keystone.service[88367]: DEBUG dbcounter [-] [88367] Writing DB stats keystone:SELECT=57,keystone:DELETE=9,keystone:INSERT=2 {{(pid=88367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:20:53.803459 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG dbcounter [-] [88368] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=2 {{(pid=88368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 16:24:57.646678 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23c5ef-b34c-423a-b335-ea0363ed30b2 admin admin] Authenticating user token {{(pid=88368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 16:24:57.648126 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-6a23c5ef-b34c-423a-b335-ea0363ed30b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:24:57.780105 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23c5ef-b34c-423a-b335-ea0363ed30b2 admin admin] Validating token access rules against request {{(pid=88368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 16:24:57.841315 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd024f-4c73-4f80-8c69-89aef724df5f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '580372230aad44269e3e0a7b230533f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48fb7e21c6864d30b70ffca9093afec8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 16:24:57.841929 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd024f-4c73-4f80-8c69-89aef724df5f service placement] REQUEST_METHOD: `GET` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 16:24:57.842205 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd024f-4c73-4f80-8c69-89aef724df5f service placement] SCRIPT_NAME: `/identity` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 16:24:57.842476 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd024f-4c73-4f80-8c69-89aef724df5f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 16:24:57.845657 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.fernet_utils [None req-c3fd024f-4c73-4f80-8c69-89aef724df5f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 16:24:57.857322 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd024f-4c73-4f80-8c69-89aef724df5f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 16:24:57.859142 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd024f-4c73-4f80-8c69-89aef724df5f service placement] RBAC: Authorization granted {{(pid=88368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 16:24:57.869301 dv-osbrick-849021-5-ceph devstack@keystone.service[88368]: [pid: 88368|app: 0|req: 634/1256] 10.222.0.70 () {60 vars in 1365 bytes} [Fri Aug 19 16:24:57 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)